Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add permissions configuration for file output #4638

Closed
wants to merge 101 commits into from
Closed
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
101 commits
Select commit Hold shift + click to select a range
1cd38f7
Add permissions configuration for file output
Jul 7, 2017
e699a6f
Add permissions configuration for file output
Jul 10, 2017
855af00
Merge branch 'master' of github.com:plassa-b/beats
Jul 10, 2017
aca6d5e
Small change
Jul 10, 2017
aedc2ae
Merge remote-tracking branch 'upstream/master'
Jul 19, 2017
2f407bd
Change config.reference.yml appropriatly & fix wrong value in docs
Jul 19, 2017
e2c5ace
Fix bug when no value given for permissions & add proper default valu…
Jul 19, 2017
2380939
Merge branch 'master' into master
andrewkroh Sep 7, 2017
a49463c
Keep docker & k8s pod annotations while they are needed (#5084)
exekias Sep 7, 2017
c76f14f
Support receiving events from audit multicast group (#5081)
andrewkroh Sep 8, 2017
ac9561d
Remove alias from perfmon docs (#5130)
andrewkroh Sep 8, 2017
01841ce
should use strings.Contains(string(cmdline), process) instead (#5102)
wgliang Sep 8, 2017
9f2795e
Add missing link texts to fields references (#4919)
Sep 8, 2017
68a6f35
Update ES test version to 7.0.0-alpha1 (#5142)
ruflin Sep 11, 2017
0d89cc7
Add flush timeout setting to filebeat registrar (#5146)
Sep 11, 2017
ccc4ab1
[Docs] Fix incorrect ES output config example (#5118)
dedemorton Sep 11, 2017
c2d7b13
[Docs] Add option to log messages in JSON (#4931)
dedemorton Sep 11, 2017
b247e88
Remove runner creation from every reload check (#5141)
vjsamuel Sep 12, 2017
6082603
Reorder processors in publisher pipeline (#5149)
Sep 12, 2017
ffd23a9
Add specialized buffers to memqueue (#5148)
Sep 12, 2017
7112a80
Add support for post-update command (#5154)
ruflin Sep 12, 2017
1530fec
Fix kubernetes matcher registry lookup (#5159)
vjsamuel Sep 12, 2017
885c2d1
Fix the bullets from the redis docs (#5143)
monicasarbu Sep 12, 2017
46dbdbd
Add @metadata.version to json events (#5166)
Sep 12, 2017
052172f
Update queue.mem defaults (#5150)
Sep 13, 2017
5d26d2c
Fix systemd unit file name in Debian package (#5174)
praseodym Sep 15, 2017
dc5ab42
Add cloudwatchmetric beat to list of community beats. (#5177)
phillbaker Sep 15, 2017
9a4fbbb
Add open_pr script (#5186)
tsg Sep 18, 2017
6829fbc
Allow IndexPrefix to be set. (#5161)
simitt Sep 18, 2017
1f07cdc
[DOCS] Update link to certgen command
lcawl Sep 18, 2017
b2821be
Merge pull request #5197 from lcawl/lcawley-certgen
lcawl Sep 18, 2017
bc98e1a
Remove kibana `depends_on` elasticsearch (#5199)
exekias Sep 19, 2017
291cd9b
Ensure docs are build locally just as they are in prod (#5201)
watson Sep 20, 2017
bc84970
Update `beta` messages for config reload (#5202)
exekias Sep 20, 2017
c0de062
Fix packetbeat flaky tests (#5200)
tsg Sep 20, 2017
23f6efe
Fix default paths in macOS for Redis 4.0.1 (#5173)
monicasarbu Sep 20, 2017
c2bd3ef
Remove ID from Runner interface (#5158)
vjsamuel Sep 20, 2017
25b90ae
[Logging] Include Logstash host info in debug messages #5198 (#5208)
Sep 20, 2017
3effafd
Add LICENSE.txt into the packages (#5215)
tsg Sep 21, 2017
b0757d2
Do not clean ignored files in merge_pr script (#5195)
ruflin Sep 21, 2017
10af6f9
Remove changeme password from the docs (#5214)
dedemorton Sep 21, 2017
22e46ed
Fix flaky reload tests (#5221)
ruflin Sep 21, 2017
57aaa90
Allow for more than one index file in docs folders. (#5220)
simitt Sep 21, 2017
ae2f13b
Added the 5.x version of the Auditbeat dashboards (#5222)
tsg Sep 25, 2017
57f67e7
Improve logging for Size changes (#5194)
ruflin Sep 25, 2017
f1bc714
cms_get and cmd_set mixed up in memcached module (#5189)
dariusj18 Sep 25, 2017
829f833
Added changelog entry for #5189 (#5231)
tsg Sep 25, 2017
10d0960
Update outputconfig.asciidoc (#5157) (#5232)
tsg Sep 25, 2017
6f6a072
Add script to test against apm-server (#5099)
ruflin Sep 25, 2017
5ecba0f
Add jenkins scripts to repo (#5235)
andrewkroh Sep 25, 2017
f61ecc3
Add .go files style to editorconfig (#5236)
pgilad Sep 25, 2017
ebf641e
Remove multiple output comment from config (#5193)
andrewkroh Sep 25, 2017
aaf34c8
Add yml file with the list of dashboards available for Auditbeat (#5182)
monicasarbu Sep 26, 2017
0b104ff
Add fix implemented in #4845 (#5253)
dedemorton Sep 27, 2017
94b6298
Update import/export dashboards section (#5229)
monicasarbu Sep 27, 2017
71bfaaa
Basic RabbitMQ queues metricset (#4788)
kvalev Sep 27, 2017
e0d7c16
Create a separate deashboard for Nginx access and error logs (#5240)
monicasarbu Sep 27, 2017
9a3ab3f
Remove broken options runoptions.uid and runoptions.gid (#5261)
tsg Sep 28, 2017
3c13108
Change field type of http header from nested to object (#5258)
ruflin Sep 29, 2017
d0f9e19
Move Field(s) to common. (#5271)
simitt Sep 29, 2017
e912823
Fix mapping for ceph num_remapped_pgs field (#5273)
ruflin Oct 2, 2017
247ee16
Update latest environment to 6.0.0-rc1 (#5274)
ruflin Oct 2, 2017
1751c26
Rewrite Generate-Index-Pattern in Go. (#5272)
simitt Oct 2, 2017
b98ba2d
Fix minor typos (#5286)
exekias Oct 2, 2017
3c075f7
Add filesystem stats to ES node_stats metricset (#5230)
ruflin Oct 2, 2017
ffca490
Align kibana index generation to beats standard. (#5290)
simitt Oct 2, 2017
8d79c8f
Add additional php-fpm pool status kpis for Metricbeat module (#5287)
pgilad Oct 3, 2017
4c910e5
Implement logic for disabled groups (#5295)
simitt Oct 3, 2017
397e241
Fixed typos in reference config files and added default value for loa…
DdPerna Oct 3, 2017
88680a8
Add multifields support. (#5296)
simitt Oct 3, 2017
b3ca270
Allow values to be set from outside (#5297)
simitt Oct 3, 2017
166c5ae
Support multiple format params. (#5299)
simitt Oct 3, 2017
834c4c2
Add scripts support. (#5298)
simitt Oct 3, 2017
91bea8e
Run make misspell (#5300)
ruflin Oct 3, 2017
806ee83
Make cleanup more reliable (#5303)
ruflin Oct 3, 2017
6b85d18
Fix data race accessing watched containers (#5307)
exekias Oct 3, 2017
6e07d0b
Add Pre-Commit hook. (#5305)
simitt Oct 3, 2017
16be171
Increase Kibana timeout for tests (#5316)
ruflin Oct 4, 2017
9b52b39
Fix flaky Filebeat test on Windows (#5314)
ruflin Oct 4, 2017
4cb8714
Fix OutputPrecision to be int instead of string. (#5318)
simitt Oct 4, 2017
d4633ad
Add Collectbeat to community beats (#5327)
vjsamuel Oct 5, 2017
396cff7
Deprecate config_dir (Filebeat) and refactor docs (#5321)
tsg Oct 5, 2017
9a431f1
Changelog cleanup in master (#5322)
tsg Oct 5, 2017
ce9e47b
Do not require template if index change and template disabled (#5319)
ruflin Oct 5, 2017
4778c51
Improvements and fixes to the Host Overview dashboard (#5340)
tsg Oct 6, 2017
28cee61
Add support TLS renegotiation (#5353)
andrewkroh Oct 9, 2017
a5d5fbe
Remove post-update command (#5306)
ruflin Oct 9, 2017
67b6648
Switch to Kibana 6.0.0-rc1 and increase retry to 300 (#5358)
ruflin Oct 9, 2017
3ffa7c5
Fix RabbitMQ 5.x dashboard names (#5359)
tsg Oct 9, 2017
f9ac23f
Introduce jenkins_setup command to be reused (#5315)
ruflin Oct 9, 2017
54a4481
Add queue settings to docs (#4884)
Oct 9, 2017
4f13672
Fix Test_Rotator's segmentation fault
Oct 10, 2017
1a98c80
Only read go version from .go-version file (#5367)
ruflin Oct 10, 2017
483982b
Add Azure VM support for add_cloud_metadata processor (#5355)
saada Oct 10, 2017
d6c118c
Add permissions configuration for file output
Jul 7, 2017
f98de95
Add permissions configuration for file output
Jul 10, 2017
8876ded
Small change
Jul 10, 2017
d825830
Change config.reference.yml appropriatly & fix wrong value in docs
Jul 19, 2017
8227731
Fix bug when no value given for permissions & add proper default valu…
Jul 19, 2017
9a136fb
Fix Test_Rotator's segmentation fault
Oct 10, 2017
d9f265b
Merge branch 'master' of github.com:plassa-b/beats
Oct 11, 2017
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 4 additions & 0 deletions .editorconfig
Original file line number Diff line number Diff line change
Expand Up @@ -7,6 +7,10 @@ end_of_line = lf
insert_final_newline = true
trim_trailing_whitespace = true

[.go]
indent_size = 4
indent_style = tab

[*.json]
indent_size = 4
indent_style = space
Expand Down
181 changes: 148 additions & 33 deletions CHANGELOG.asciidoc
Original file line number Diff line number Diff line change
Expand Up @@ -24,35 +24,31 @@ https://github.com/elastic/beats/compare/v6.0.0-beta2...master[Check the HEAD di

*Packetbeat*

- Remove not-working `runoptions.uid` and `runoptions.gid` options in Packetbeat. {pull}5261[5261]

*Winlogbeat*

==== Bugfixes

*Affecting all Beats*
- Fix go plugins not loaded when beat starts {pull}4799[4799]
- Eliminate deprecated _default_ mapping in 6.x {pull}4864[4864]
- Register kubernetes `field_format` matcher and remove logger in `Encode` API {pull}4888[4888]
- Add support for `initContainers` in `add_kubernetes_metadata` processor. {issue}4825[4825]
- Fix the `/usr/bin/beatname` script to accept `-d "*"` as a parameter. {issue}5040[5040]
- Combine `fields.yml` properties when they are defined in different sources. {issue}5075[5075]
- Fix `fields.yml` lookup when using `export template` with a custom `path.config` param. {issue}5089[5089]

- Fix data race accessing watched containers. {issue}5147[5147]
- Remove ID() from Runner interface {issue}5153[5153]
- Do not require template if index change and template disabled {pull}5319[5319]

*Auditbeat*

*Filebeat*

- Fix default paths for redis 4.0.1 logs on macOS {pull}5173[5173]

*Heartbeat*

*Metricbeat*

- Support `npipe` protocol (Windows) in Docker module. {pull}4751[4751]
- Added missing mongodb configuration file to the `modules.d` folder. {pull}4870[4870]
- Fix wrong MySQL CRUD queries timelion visualization {pull}4857[4857]
- Add new metrics to CPU metricsset {pull}4969[4969]
- Fix a memory allocation issue where more memory was allocated than needed in the windows-perfmon metricset. {issue}5035[5035]
- Don't start metricbeat if external modules config is wrong and reload is disabled {pull}5053[5053]
- Fix kubernetes events module to be able to index time fields properly. {issue}5093[5093]
- The MongoDB module now connects on each fetch, to avoid stopping the whole Metricbeat instance if MongoDB is not up when starting. {pull}5120[5120]
- Change field type of http header from nested to object {pull}5258[5258]
- Use `beat.name` instead of `beat.hostname` in the Host Overview dashboard. {pull}5340[5340]
- Fix the loading of 5.x dashboards. {issue}5277[5277]

*Packetbeat*

Expand All @@ -66,47 +62,43 @@ https://github.com/elastic/beats/compare/v6.0.0-beta2...master[Check the HEAD di
- Changed the hashbang used in the beat helper script from `/bin/bash` to `/usr/bin/env bash`. {pull}5051[5051]
- Changed beat helper script to use `exec` when running the beat. {pull}5051[5051]
- Fix reloader error message to only print on actual error {pull}5066[5066]
- Add support for enabling TLS renegotiation. {issue}4386[4386]
- Add Azure VM support for add_cloud_metadata processor {pull}5355[5355]

*Auditbeat*

- Changed the number of shards in the default configuration to 3. {issue}5095[5095]

*Filebeat*

- Add PostgreSQL module with slowlog support. {pull}4763[4763]
- Add Kafka log module. {pull}4885[4885]
- Add support for `/var/log/containers/` log path in `add_kubernetes_metadata` processor. {pull}4981[4981]
- Don't start filebeat if external modules/prospectors config is wrong and reload is disabled {pull}5053[5053]
- Remove error log from runnerfactory as error is returned by API. {pull}5085[5085]
- Changed the number of shards in the default configuration to 3. {issue}5095[5095]
- Remove error log from runnerfactory as error is returned by API. {pull}5085[5085]

*Heartbeat*

- Changed the number of shards in the default configuration to 1. {issue}5095[5095]

*Metricbeat*

- Add graphite protocol metricbeat module. {pull}4734[4734]
- Add http server metricset to support push metrics via http. {pull}4770[4770]
- Make config object public for graphite and http server {pull}4820[4820]
- Add system uptime metricset. {issue}[4848[4848]
- Add experimental `queue` metricset to RabbitMQ module. {pull}4788[4788]
- Add additional php-fpm pool status kpis for Metricbeat module {pull}5287[5287]
- Auto-select a hostname (based on the host on which the Beat is running) in the Host Overview dashboard. {pull}5340[5340]

*Packetbeat*

- Changed the number of shards in the default configuration to 3. {issue}5095[5095]

*Winlogbeat*

- Changed the number of shards in the default configuration to 3. {issue}5095[5095]

==== Deprecated

*Affecting all Beats*

- Fix pod name indexer to use both namespace, pod name to frame index key {pull}4775[4775]

*Filebeat*

- The `filebeat.config_dir` option is deprecated. Use `filebeat.config.prospector` options instead. {pull}5321[5321]

*Heartbeat*

*Metricbeat*
Expand All @@ -120,6 +112,61 @@ https://github.com/elastic/beats/compare/v6.0.0-beta2...master[Check the HEAD di

////////////////////////////////////////////////////////////

[[release-notes-6.0.0-rc1]]
=== Beats version 6.0.0-rc1
https://github.com/elastic/beats/compare/v6.0.0-beta2...v6.0.0-rc1[View commits]

==== Bugfixes

*Affecting all Beats*

- Fix the `/usr/bin/beatname` script to accept `-d "*"` as a parameter. {issue}5040[5040]
- Combine `fields.yml` properties when they are defined in different sources. {issue}5075[5075]
- Keep Docker & Kubernetes pod metadata after container dies while they are needed by processors. {pull}5084[5084]
- Fix `fields.yml` lookup when using `export template` with a custom `path.config` param. {issue}5089[5089]
- Remove runner creation from every reload check {pull}5141[5141]
- Fix add_kubernetes_metadata matcher registry lookup. {pull}5159[5159]

*Metricbeat*

- Fix a memory allocation issue where more memory was allocated than needed in the windows-perfmon metricset. {issue}5035[5035]
- Don't start metricbeat if external modules config is wrong and reload is disabled {pull}5053[5053]
- The MongoDB module now connects on each fetch, to avoid stopping the whole Metricbeat instance if MongoDB is not up when starting. {pull}5120[5120]
- Fix kubernetes events module to be able to index time fields properly. {issue}5093[5093]
- Fixed `cmd_set` and `cmd_get` being mixed in the Memcache module. {pull}5189[5189]


==== Added

*Affecting all Beats*

- Enable flush timeout by default. {pull}5150[5150]
- Add @metadata.version to events send to Logstash. {pull}5166[5166]

*Auditbeat*

- Changed the number of shards in the default configuration to 3. {issue}5095[5095]
- Add support for receiving audit events using a multicast socket. {issue}4850[4850]

*Filebeat*

- Changed the number of shards in the default configuration to 3. {issue}5095[5095]
- Don't start filebeat if external modules/prospectors config is wrong and reload is disabled {pull}5053[5053]
- Add `filebeat.registry_flush` setting, to delay the registry updates. {pull}5146[5146]

*Heartbeat*

- Changed the number of shards in the default configuration to 1. {issue}5095[5095]

*Packetbeat*

- Changed the number of shards in the default configuration to 3. {issue}5095[5095]

*Winlogbeat*

- Changed the number of shards in the default configuration to 3. {issue}5095[5095]


[[release-notes-6.0.0-beta2]]
=== Beats version 6.0.0-beta2
https://github.com/elastic/beats/compare/v6.0.0-beta1...v6.0.0-beta2[View commits]
Expand All @@ -144,6 +191,7 @@ https://github.com/elastic/beats/compare/v6.0.0-beta1...v6.0.0-beta2[View commit
- Fix go plugins not loaded when beat starts {pull}4799[4799]
- Add support for `initContainers` in `add_kubernetes_metadata` processor. {issue}4825[4825]
- Eliminate deprecated _default_ mapping in 6.x {pull}4864[4864]
- Fix pod name indexer to use both namespace, pod name to frame index key {pull}4775[4775]

*Heartbeat*

Expand Down Expand Up @@ -177,12 +225,6 @@ https://github.com/elastic/beats/compare/v6.0.0-beta1...v6.0.0-beta2[View commit
- Add `filesystem.ignore_types` to system module for ignoring filesystem types. {issue}4685[4685]
- Add support to exclude labels from kubernetes pod metadata. {pull}4757[4757]

==== Deprecated

*Affecting all Beats*

- Fix pod name indexer to use both namespace, pod name to frame index key {pull}4775[4775]


[[release-notes-6.0.0-beta1]]
=== Beats version 6.0.0-beta1
Expand Down Expand Up @@ -510,6 +552,79 @@ https://github.com/elastic/beats/compare/v5.4.0...v6.0.0-alpha1[View commits]

- Prospector reloading only works properly with new files. {pull}3546[3546]

[[release-notes-5.6.2]]
=== Beats version 5.6.2
https://github.com/elastic/beats/compare/v5.6.1...v5.6.2[View commits]

No changes in this release.

[[release-notes-5.6.1]]
=== Beats version 5.6.1
https://github.com/elastic/beats/compare/v5.6.0...v5.6.1[View commits]

No changes in this release.

[[release-notes-5.6.0]]
=== Beats version 5.6.0
https://github.com/elastic/beats/compare/v5.5.3...v5.6.0[View commits]

==== Breaking changes

*Affecting all Beats*

- The _all.norms setting in the Elasticsearch template is no longer disabled.
This increases the storage size with one byte per document, but allows for a
better upgrade experience to 6.0. {issue}4901[4901]


==== Bugfixes

*Filebeat*

- Fix issue where the `fileset.module` could have the wrong value. {issue}4761[4761]

*Packetbeat*

- Update flow timestamp on each packet being received. {issue}4895[4895]

*Metricbeat*

- Fix a debug statement that said a module wrapper had stopped when it hadn't. {pull}4264[4264]
- Use MemAvailable value from /proc/meminfo on Linux 3.14. {pull}4316[4316]
- Fix panic when events were dropped by filters. {issue}4327[4327]

==== Added

*Affecting all Beats*

- Add option to the import_dashboards script to load the dashboards via Kibana API. {pull}4682[4682]

*Filebeat*

- Add support for loading Xpack Machine Learning configurations from the modules, and added sample configurations for the Nginx module. {pull}4506[4506] {pull}4609[4609]
- Add ability to parse nginx logs exposing the X-Forwarded-For header instead of the remote address. {pull}4351[4351]

*Metricbeat*

- Add `filesystem.ignore_types` to system module for ignoring filesystem types. {issue}4685[4685]

==== Deprecated

*Affecting all Beats*

- Loading more than one output is deprecated and will be removed in 6.0. {pull}4907[4907]

[[release-notes-5.5.3]]
=== Beats version 5.5.3
https://github.com/elastic/beats/compare/v5.5.2...v5.5.3[View commits]

No changes in this release.

[[release-notes-5.5.2]]
=== Beats version 5.5.2
https://github.com/elastic/beats/compare/v5.5.1...v5.5.2[View commits]

No changes in this release.
[[release-notes-5.5.1]]
=== Beats version 5.5.1
https://github.com/elastic/beats/compare/v5.5.0...v5.5.1[View commits]
Expand Down
2 changes: 1 addition & 1 deletion LICENSE → LICENSE.txt
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
Copyright (c) 2012–2016 Elasticsearch <http://www.elastic.co>
Copyright (c) 2012–2017 Elastic <http://www.elastic.co>

Licensed under the Apache License, Version 2.0 (the "License");
you may not use this file except in compliance with the License.
Expand Down
14 changes: 13 additions & 1 deletion Makefile
Original file line number Diff line number Diff line change
Expand Up @@ -15,6 +15,12 @@ REVIEWDOG_REPO=github.com/haya14busa/reviewdog/cmd/reviewdog

# Runs complete testsuites (unit, system, integration) for all beats with coverage and race detection.
# Also it builds the docs and the generators

.PHONY: setup-commit-hook
setup-commit-hook:
@cp script/pre_commit.sh .git/hooks/pre-commit
@chmod 751 .git/hooks/pre-commit

.PHONY: testsuite
testsuite:
@$(foreach var,$(PROJECTS),$(MAKE) -C $(var) testsuite || exit 1;)
Expand Down Expand Up @@ -72,7 +78,8 @@ check: python-env
.PHONY: misspell
misspell:
go get github.com/client9/misspell
$(FIND) -name '*' -exec misspell -w {} \;
# Ignore Kibana files (.json)
$(FIND) -not -path "*.json" -name '*' -exec misspell -w {} \;

.PHONY: fmt
fmt: python-env
Expand Down Expand Up @@ -140,3 +147,8 @@ notice: python-env
python-env:
@test -d $(PYTHON_ENV) || virtualenv $(VIRTUALENV_PARAMS) $(PYTHON_ENV)
@$(PYTHON_ENV)/bin/pip install -q --upgrade pip autopep8 six

# Tests if apm works with the current code
.PHONY: python-env
test-apm:
sh ./script/test_apm.sh
4 changes: 2 additions & 2 deletions NOTICE → NOTICE.txt
Original file line number Diff line number Diff line change
Expand Up @@ -314,8 +314,8 @@ OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
SOFTWARE.
--------------------------------------------------------------------
Dependency: github.com/elastic/go-libaudit
Version: v0.0.5
Revision: 3a005d3d0bbcee26d60e3ab2f1890699746f4da6
Version: v0.0.6
Revision: df0d4981f3fce65ffd3d7411dfec3e03231b491c
License type (autodetected): Apache License 2.0
./vendor/github.com/elastic/go-libaudit/LICENSE:
--------------------------------------------------------------------
Expand Down
Loading