Skip to content

Commit

Permalink
Backport doc changes into 5.0 (#2847)
Browse files Browse the repository at this point in the history
* Clarify instructions for running configtest

* Add to FAQ the solution for having nested JSON objects under Discovery (#2726)

* docs: Fix broken Kibana doc link in faq (#2837)

The Kibana docs overhaul for 5.0+ changed the link to the index pattern
field refresh instructions.

* Use variable for filepath plus some light edits (#2838)
  • Loading branch information
dedemorton authored and Steffen Siering committed Oct 25, 2016
1 parent 41d228e commit fa08f52
Show file tree
Hide file tree
Showing 14 changed files with 79 additions and 11 deletions.
8 changes: 6 additions & 2 deletions filebeat/docs/getting-started.asciidoc
Original file line number Diff line number Diff line change
Expand Up @@ -139,14 +139,18 @@ output.elasticsearch:
+
If you are sending output to Logstash, see <<config-filebeat-logstash>> instead.

TIP: To test your configuration file, run Filebeat in the foreground with the following options specified:
+./filebeat -configtest -e+.
TIP: To test your configuration file, change to the directory where the Filebeat
binary is installed, and run Filebeat in the foreground with the following
options specified: +./filebeat -configtest -e+. Make sure your config files are
in the path expected by Filebeat (see <<directory-layout>>). If you
installed from DEB or RPM packages, run +./filebeat.sh -configtest -e+.

See <<filebeat-configuration-details>> for more details about each configuration option.

[[config-filebeat-logstash]]
=== Step 3: Configuring Filebeat to Use Logstash

:allplatforms:
include::../../libbeat/docs/shared-logstash-config.asciidoc[]

[[filebeat-template]]
Expand Down
1 change: 1 addition & 0 deletions filebeat/docs/index.asciidoc
Original file line number Diff line number Diff line change
Expand Up @@ -38,6 +38,7 @@ include::../../libbeat/docs/shared-env-vars.asciidoc[]

include::./multiple-prospectors.asciidoc[]

:allplatforms:
include::../../libbeat/docs/yaml.asciidoc[]

include::../../libbeat/docs/regexp.asciidoc[]
Expand Down
5 changes: 3 additions & 2 deletions libbeat/docs/config-file-format.asciidoc
Original file line number Diff line number Diff line change
Expand Up @@ -355,8 +355,9 @@ simply uncomment the line and change the values.
[float]
==== Test Your Config File

You can test your configuration file to verify that the structure is valid. Simply run
your in the foreground with the `-configtest` flag specified. For example:
You can test your configuration file to verify that the structure is valid.
Simply change to the directory where the binary is installed, and run
your Beat in the foreground with the `-configtest` flag specified. For example:

["source","yaml",subs="attributes,callouts"]
----------------------------------------------------------------------
Expand Down
23 changes: 23 additions & 0 deletions libbeat/docs/faq-refresh-index.asciidoc
Original file line number Diff line number Diff line change
@@ -0,0 +1,23 @@
[float]
[[refresh-index-pattern]]
=== Fields show up as nested JSON in Kibana?

When {beatname_uc} exports a field of type dictionary, and the keys are not known in advance, the Discovery page in Kibana will display the field as a nested JSON object:

[source,shell]
----------------------------------------------------------------------
http.response.headers = {
"content-length": 12,
"content-type": "application/json"
}
----------------------------------------------------------------------
To fix this you need to {kibanadoc}/index-patterns.html#reload-fields[reload the index pattern] in Kibana under the Management->Index Patterns, and the index pattern will be
updated with a field for each key available in the dictionary:

[source,shell]
----------------------------------------------------------------------
http.response.headers.content-length = 12
http.response.headers.content-type = "application/json"
----------------------------------------------------------------------


19 changes: 17 additions & 2 deletions libbeat/docs/shared-logstash-config.asciidoc
Original file line number Diff line number Diff line change
Expand Up @@ -29,8 +29,23 @@ Beats connections.
For this configuration, you must <<load-template-manually,load the index template into Elasticsearch manually>>
because the options for auto loading the template are only available for the Elasticsearch output.

TIP: To test your configuration file, run {beatname_uc} in the foreground with the following options specified:
+./{beatname_lc} -configtest -e+.
ifdef::allplatforms[]

TIP: To test your configuration file, change to the directory where the {beatname_uc}
binary is installed, and run {beatname_uc} in the foreground with the following
options specified: +./{beatname_lc} -configtest -e+. Make sure your config files are
in the path expected by {beatname_uc} (see <<directory-layout>>). If you
installed from DEB or RPM packages, run +./{beatname_lc}.sh -configtest -e+.

endif::allplatforms[]

ifdef::win[]

TIP: To test your configuration file, change to the directory where the {beatname_uc}
binary is installed, and run {beatname_uc} in the foreground with the following
options specified: +.\winlogbeat.exe -c .\winlogbeat.yml -configtest -e+.

endif::win[]

To use this configuration, you must also
{libbeat}/logstash-installation.html#logstash-setup[set up Logstash] to receive events
Expand Down
18 changes: 16 additions & 2 deletions libbeat/docs/yaml.asciidoc
Original file line number Diff line number Diff line change
Expand Up @@ -31,14 +31,28 @@ simply uncomment the line and change the setting.
[float]
=== Test Your Config File

You can test your configuration file to verify that the structure is valid. Simply run
You can test your configuration file to verify that the structure is valid.
Simply change to the directory where the binary is installed, and run
{beatname_uc} in the foreground with the `-configtest` flag specified. For example:

["source","yaml",subs="attributes,callouts"]
ifdef::allplatforms[]

["source","shell",subs="attributes"]
----------------------------------------------------------------------
{beatname_lc} -c {beatname_lc}.yml -configtest
----------------------------------------------------------------------

endif::allplatforms[]

ifdef::win[]

["source","shell",subs="attributes"]
----------------------------------------------------------------------
.\winlogbeat.exe -c .\winlogbeat.yml -configtest -e
----------------------------------------------------------------------

endif::win[]

You'll see a message if {beatname_uc} finds an error in the file.

[float]
Expand Down
1 change: 1 addition & 0 deletions metricbeat/docs/configuring-logstash.asciidoc
Original file line number Diff line number Diff line change
@@ -1,4 +1,5 @@
[[config-metricbeat-logstash]]
== Configuring Metricbeat to Use Logstash

:allplatforms:
include::../../libbeat/docs/shared-logstash-config.asciidoc[]
1 change: 1 addition & 0 deletions metricbeat/docs/index.asciidoc
Original file line number Diff line number Diff line change
Expand Up @@ -35,6 +35,7 @@ include::./configuring-logstash.asciidoc[]

include::../../libbeat/docs/shared-env-vars.asciidoc[]

:allplatforms:
include::../../libbeat/docs/yaml.asciidoc[]

include::../../libbeat/docs/regexp.asciidoc[]
Expand Down
1 change: 1 addition & 0 deletions packetbeat/docs/configuring-logstash.asciidoc
Original file line number Diff line number Diff line change
@@ -1,4 +1,5 @@
[[config-packetbeat-logstash]]
== Configuring Packetbeat to Use Logstash

:allplatforms:
include::../../libbeat/docs/shared-logstash-config.asciidoc[]
3 changes: 2 additions & 1 deletion packetbeat/docs/faq.asciidoc
Original file line number Diff line number Diff line change
Expand Up @@ -71,4 +71,5 @@ option. However, keep in mind that very large timeout values can increase memory
response messages are not sent.

include::../../libbeat/docs/faq-limit-bandwidth.asciidoc[]
include::../../libbeat/docs/shared-faq.asciidoc[]
include::../../libbeat/docs/shared-faq.asciidoc[]
include::../../libbeat/docs/faq-refresh-index.asciidoc[]
7 changes: 5 additions & 2 deletions packetbeat/docs/gettingstarted.asciidoc
Original file line number Diff line number Diff line change
Expand Up @@ -187,8 +187,11 @@ output.elasticsearch:
+
If you are sending output to Logstash, see <<config-packetbeat-logstash>> instead.

TIP: To test your configuration file, run Packetbeat in the foreground with the following options specified:
+sudo ./packetbeat -configtest -e+.
TIP: To test your configuration file, change to the directory where the Packetbeat
binary is installed, and run Packetbeat in the foreground with the following
options specified: +sudo ./packetbeat -configtest -e+. Make sure your config files are
in the path expected by Packetbeat (see <<directory-layout>>). If you
installed from DEB or RPM packages, run +sudo ./packetbeat.sh -configtest -e+.

[[packetbeat-template]]
=== Step 3: Loading the Index Template in Elasticsearch
Expand Down
1 change: 1 addition & 0 deletions packetbeat/docs/index.asciidoc
Original file line number Diff line number Diff line change
Expand Up @@ -45,6 +45,7 @@ include::./thrift.asciidoc[]

include::./maintaining-topology.asciidoc[]

:allplatforms:
include::../../libbeat/docs/yaml.asciidoc[]

include::./fields.asciidoc[]
Expand Down
1 change: 1 addition & 0 deletions winlogbeat/docs/getting-started.asciidoc
Original file line number Diff line number Diff line change
Expand Up @@ -121,6 +121,7 @@ PS C:\Program Files\Winlogbeat> .\winlogbeat.exe -c .\winlogbeat.yml -configtest
[[config-winlogbeat-logstash]]
=== Step 3: Configuring Winlogbeat to Use Logstash

:win:
include::../../libbeat/docs/shared-logstash-config.asciidoc[]

[[winlogbeat-template]]
Expand Down
1 change: 1 addition & 0 deletions winlogbeat/docs/index.asciidoc
Original file line number Diff line number Diff line change
Expand Up @@ -32,6 +32,7 @@ include::../../libbeat/docs/shared-config-ingest.asciidoc[]

include::../../libbeat/docs/shared-env-vars.asciidoc[]

:win:
include::../../libbeat/docs/yaml.asciidoc[]

include::./fields.asciidoc[]
Expand Down

0 comments on commit fa08f52

Please sign in to comment.