Merge branch 'master' into fix_existOrFail

elastic · Nov 15, 2019 · df16f37 · df16f37
2 parents 218d70d + 1a8bb3a
commit df16f37
Show file tree

Hide file tree

Showing 270 changed files with 7,196 additions and 1,910 deletions.
diff --git a/.github/CODEOWNERS b/.github/CODEOWNERS
@@ -28,11 +28,6 @@
 # Canvas
 /x-pack/legacy/plugins/canvas/  @elastic/kibana-canvas
 
-# Code
-/x-pack/legacy/plugins/code/  @teams/code
-/x-pack/test/functional/apps/code/  @teams/code
-/x-pack/test/api_integration/apis/code/  @teams/code
-
 # Logs & Metrics UI
 /x-pack/legacy/plugins/infra/ @elastic/logs-metrics-ui
 /x-pack/legacy/plugins/integrations_manager/ @elastic/epm

diff --git a/.sass-lint.yml b/.sass-lint.yml
@@ -2,7 +2,6 @@ files:
   include:
     - 'src/legacy/core_plugins/metrics/**/*.s+(a|c)ss'
     - 'src/legacy/core_plugins/timelion/**/*.s+(a|c)ss'
-    - 'src/legacy/ui/public/query_bar/**/*.s+(a|c)ss'
     - 'src/legacy/ui/public/vislib/**/*.s+(a|c)ss'
     - 'x-pack/legacy/plugins/rollup/**/*.s+(a|c)ss'
     - 'x-pack/legacy/plugins/security/**/*.s+(a|c)ss'

diff --git a/STYLEGUIDE.md b/STYLEGUIDE.md
@@ -120,6 +120,7 @@ You should prefer modern language features in a lot of cases, e.g.:
 * Prefer arrow function over storing `this` (no `const self = this;`)
 * Prefer template strings over string concatenation
 * Prefer the spread operator for copying arrays (`[...arr]`) over `arr.slice()`
+* Use optional chaining (`?.`) and nullish Coalescing (`??`) over `lodash.get` (and similar utilities)
 
 ### Avoid mutability and state
 

diff --git a/docs/management/advanced-options.asciidoc b/docs/management/advanced-options.asciidoc
diff --git a/docs/setup/settings.asciidoc b/docs/setup/settings.asciidoc
@@ -32,7 +32,8 @@ strongly recommend that you keep the default CSP rules that ship with Kibana.
 
 `csp.strict:`:: *Default: `true`* Blocks access to Kibana to any browser that
 does not enforce even rudimentary CSP rules. In practice, this will disable
-support for older, less safe browsers like Internet Explorer.
+support for older, less safe browsers like Internet Explorer. 
+See <<csp-strict-mode, Content Security Policy>> for more information.
 
 `csp.warnLegacyBrowsers:`:: *Default: `true`* Shows a warning message after
 loading Kibana to any browser that does not enforce even rudimentary CSP rules,
@@ -319,6 +320,18 @@ supported protocols with versions. Valid protocols: `TLSv1`, `TLSv1.1`, `TLSv1.2
 setting this to `true` enables unauthenticated users to access the Kibana
 server status API and status page.
 
+`telemetry.allowChangingOptInStatus`:: *Default: true*. If `true`, 
+users are able to change the telemetry setting at a later time in 
+<<advanced-options, Advanced Settings>>.  If `false`, 
+{kib} looks at the value of `telemetry.optIn` to determine whether to send 
+telemetry data or not. `telemetry.allowChangingOptInStatus` and `telemetry.optIn`
+cannot be `false` at the same time.
+
+`telemetry.optIn`:: *Default: true* If `true`, telemetry data is sent to Elastic. 
+ If `false`, collection of telemetry data is disabled.  
+ To enable telemetry and prevent users from disabling it,
+ set `telemetry.allowChangingOptInStatus` to `false` and `telemetry.optIn` to `true`.
+
 `vega.enableExternalUrls:`:: *Default: false* Set this value to true to allow Vega to use any URL to access external data sources and images. If false, Vega can only get data from Elasticsearch.
 
 `xpack.license_management.enabled`:: *Default: true* Set this value to false to

diff --git a/docs/setup/upgrade.asciidoc b/docs/setup/upgrade.asciidoc
@@ -2,7 +2,15 @@
 == Upgrading {kib}
 
 Depending on the {kib} version you're upgrading from, the upgrade process to 7.0
-varies.
+varies. 
+
+NOTE: {kib} upgrades automatically when starting a new version, as described in 
+<<upgrade-migrations, this document>>.
+Although you do not need to manually back up {kib} before upgrading, we recommend
+that you have a backup on hand. You can use  
+<<snapshot-repositories, Snapshot and Restore>> to back up {kib}
+data by targeting `.kibana*` indices. If you are using the Reporting plugin, 
+you can also target `.reporting*` indices.
 
 [float]
 [[upgrade-before-you-begin]]
@@ -12,7 +20,7 @@ Before you upgrade {kib}:
 
 * Consult the <<breaking-changes,breaking changes>>.
 * Before you upgrade production servers, test the upgrades in a dev environment.
-* Backup your data with {es} {ref}/modules-snapshots.html[snapshots].
+* Back up your data with {es} {ref}/modules-snapshots.html[snapshots].
   To roll back to an earlier version, you **must** have a backup of your data.
 * If you are using custom plugins, check that a compatible version is
   available. 

diff --git a/docs/user/graph/configuring-graph.asciidoc b/docs/user/graph/configuring-graph.asciidoc
@@ -59,14 +59,14 @@ image::user/graph/images/graph-read-only-badge.png[Example of Graph's read only
 
 [discrete]
 [[disable-drill-down]]
-=== Disabling drill down configuration
+=== Disabling drilldown configuration
 
-By default, users can configure _drill down_ URLs to display additional
+By default, users can configure _drilldown_ URLs to display additional
 information about a selected vertex in a new browser window. For example,
-you could configure a drill down URL to perform a web search for the selected
+you could configure a drilldown URL to perform a web search for the selected
 vertex term.
 
-To prevent users from adding drill down URLs,  set
+To prevent users from adding drilldown URLs,  set
 `xpack.graph.canEditDrillDownUrls` to `false` in `kibana.yml`:
 
 [source,yaml]

diff --git a/docs/user/graph/getting-started.asciidoc b/docs/user/graph/getting-started.asciidoc
@@ -2,30 +2,30 @@
 [[graph-getting-started]]
 == Using Graph
 
-Graph is automatically enabled in {es} and {kib}.
+You must index data into {es} before you can create a graph.  
+<<index-patterns, Learn how>> or get started with a <<add-sample-data, sample data set>>.
 
+[float]
 [[exploring-connections]]
-To start exploring connections in your data:
+=== Graph connections in your data
 
-. From the side navigation, open the graph explorer.
-
-. Select an index pattern to specify what indices you want to explore.
+. From the side navigation, open *Graph*.
 +
-For example, if you are indexing log data with Logstash, you could select the
-`logstash-*` index pattern to visualize connections within the log entries.
+If this is your first graph, follow the prompts to create it.  
+For subsequent graphs, click *New*.
+
+. Select a data source to explore.
 
-. Select one or more multi-value fields that contain the terms you want to
+. Add one or more multi-value fields that contain the terms you want to
 graph. 
 +
-The vertices in the graph are selected from these terms. If you're
-visualizing connections between Apache log entries, you could select the
-`url.raw` field and the `geo.src` field so you can look at which pages are
-being accessed from different locations.
+The vertices in the graph are selected from these terms.
 
 . Enter a search query to discover relationships between terms in the selected
 fields. 
 +
-For example, to generate a graph of the successful requests to
+For example, if you are using the {kib} sample web logs data set, and you want 
+to generate a graph of the successful requests to
 particular pages from different locations, you could search for the 200
 response code. The weight of the connection between two vertices indicates how strongly they
 are related. 
@@ -38,25 +38,86 @@ image::user/graph/images/graph-url-connections.png["URL connections"]
 [role="screenshot"]
 image::user/graph/images/graph-link-summary.png["Link summary"]
 
-. Use the toolbar buttons to explore
+. Use the control bar on the right to explore
 additional connections:
 +
-* To display additional vertices that connect to your graph, click Expand 
-image:user/graph/images/graph-expand-button.jpg[Expand Selection].
+* To display additional vertices that connect to your graph, click the expand icon
+image:user/graph/images/graph-expand-button.png[Expand Selection].
 * To display additional
-connections between the displayed vertices, click Link
-image:user/graph/images/graph-link-button.jpg[Add links to existing terms]  
+connections between the displayed vertices, click the link icon
+image:user/graph/images/graph-link-button.png[Add links to existing terms]. 
 * To explore a particular area of the
-graph, select the vertices you are interested in, and click Expand or Link.
-* To step back through your changes to the graph, click Undo
-image:user/graph/images/graph-undo-button.jpg[Undo].
+graph, select the vertices you are interested in, and then click expand or link.
+* To step back through your changes to the graph, click undo
+image:user/graph/images/graph-undo-button.png[Undo] and redo 
+image:user/graph/images/graph-redo-button.png[Redo].
 
 . To see more relationships in your data, submit additional queries.
 +
 [role="screenshot"]
 image::user/graph/images/graph-add-query.png["Adding networks"]
 
+. *Save* your graph.
+
+[float]
+[[style-vertex-properties]]
+=== Style vertex properties
+
+Each vertex has a color, icon, and label. To change 
+the color or icon of all vertices 
+of a certain field, click the field badge below the search bar, and then
+select *Edit settings*.
+
+To change the color and label of selected vertices, 
+click the style icon image:user/graph/images/graph-style-button.png[Style]
+in the control bar on the right. 
+
+
+[float]
+[[edit-graph-settings]]
+=== Edit graph settings
+
+By default, *Graph* is configured to tune out noise in your data. 
+If this isn't a good fit for your data, use *Settings > Advanced settings*
+to adjust the way *Graph* queries your data. You can tune the graph to show 
+only the results relevant to you and to improve performance.  
+For more information, see <<graph-troubleshooting, Graph troubleshooting>>. 
+
+You can configure the number of vertices that a search or 
+expand operation adds to the graph.
+By default, only the five most relevant terms for any given field are added 
+at a time. This keeps the graph from overflowing. To increase this number, click 
+a field below the search bar, select *Edit Settings*, and change *Terms per hop*.  
+
+[float]
+[[graph-block-terms]]
+=== Block terms from the graph
+Documents that match a blocked term are not allowed in the graph. 
+To block a term, select its vertex and click 
+the block icon
+image:user/graph/images/graph-block-button.png[Block selection]
+in the control panel.  
+For a list of blocked terms, go to *Settings > Blocked terms*.
+
+[float]
+[[graph-drill-down]]
+=== Drill down into raw documents
+With drilldowns, you can display additional information about a 
+selected vertex in a new browser window. For example, you might 
+configure a drilldown URL to perform a web search for the selected vertex term.  
+
+Use the drilldown icon image:user/graph/images/graph-info-icon.png[Drilldown selection] 
+in the control panel to show the drilldown buttons for the selected vertices.
+To configure drilldowns, go to *Settings > Drilldowns*. See also 
+<<disable-drill-down, Disabling drilldown configuration>>.
 
-NOTE: By default, when you submit a search query, Graph searches all available
-fields. You can constrain your search to a particular field using the Lucene
-query syntax. For example,  `machine.os: osx`.
+[float]
+[[graph-run-layout]]
+=== Run and pause layout
+Graph uses a "force layout", where vertices behave like magnets, 
+pushing off of one another. By default, when you add a new vertex to 
+the graph, all vertices begin moving. In some cases, the movement might 
+go on for some time. To freeze the current vertex position, 
+click the pause icon
+image:user/graph/images/graph-pause-button.png[Block selection]
+in the control panel. 
diff --git a/docs/user/graph/images/graph-add-query.png b/docs/user/graph/images/graph-add-query.png
diff --git a/docs/user/graph/images/graph-block-button.png b/docs/user/graph/images/graph-block-button.png
diff --git a/docs/user/graph/images/graph-expand-button.jpg b/docs/user/graph/images/graph-expand-button.jpg
diff --git a/docs/user/graph/images/graph-expand-button.png b/docs/user/graph/images/graph-expand-button.png
diff --git a/docs/user/graph/images/graph-info-icon.png b/docs/user/graph/images/graph-info-icon.png
diff --git a/docs/user/graph/images/graph-link-button.jpg b/docs/user/graph/images/graph-link-button.jpg
diff --git a/docs/user/graph/images/graph-link-button.png b/docs/user/graph/images/graph-link-button.png
diff --git a/docs/user/graph/images/graph-link-summary.png b/docs/user/graph/images/graph-link-summary.png
diff --git a/docs/user/graph/images/graph-pause-button.png b/docs/user/graph/images/graph-pause-button.png
diff --git a/docs/user/graph/images/graph-redo-button.png b/docs/user/graph/images/graph-redo-button.png
diff --git a/docs/user/graph/images/graph-style-button.png b/docs/user/graph/images/graph-style-button.png
diff --git a/docs/user/graph/images/graph-undo-button.jpg b/docs/user/graph/images/graph-undo-button.jpg
diff --git a/docs/user/graph/images/graph-undo-button.png b/docs/user/graph/images/graph-undo-button.png
diff --git a/docs/user/graph/images/graph-url-connections.png b/docs/user/graph/images/graph-url-connections.png
diff --git a/docs/user/graph/troubleshooting.asciidoc b/docs/user/graph/troubleshooting.asciidoc
@@ -1,6 +1,6 @@
 [role="xpack"]
 [[graph-troubleshooting]]
-== Graph Troubleshooting
+== Graph troubleshooting
 ++++
 <titleabbrev>Troubleshooting</titleabbrev>
 ++++

diff --git a/docs/user/monitoring/monitoring-troubleshooting.asciidoc b/docs/user/monitoring/monitoring-troubleshooting.asciidoc
@@ -23,6 +23,23 @@ You cannot monitor a version 6.3 or later cluster from {kib} version 6.2 or earl
 To resolve this issue, upgrade {kib} to 6.3 or later. See 
 {stack-ref}/upgrading-elastic-stack.html[Upgrading the {stack}]. 
 
+[float]
+=== {filebeat} index is corrupt
+
+*Symptoms:*
+
+The *Stack Monitoring* application displays a Monitoring Request error indicating
+that an illegal argument exception has occurred because fielddata is disabled on
+text fields by default.
+
+*Resolution*
+
+ . Stop all your {filebeat} instances.
+ . Delete indices beginning with `filebeat-$VERSION`, where `VERSION` corresponds
+   to the version of {filebeat} running.
+. Restart all your {filebeat} instances.
+
+
 [float]
 === No monitoring data is visible in {kib}
 

diff --git a/package.json b/package.json
@@ -82,7 +82,7 @@
     "**/@types/react": "16.8.3",
     "**/@types/hapi": "^17.0.18",
     "**/@types/angular": "^1.6.56",
-    "**/typescript": "3.5.3",
+    "**/typescript": "3.7.2",
     "**/graphql-toolkit/lodash": "^4.17.13",
     "**/isomorphic-git/**/base64-js": "^1.2.1",
     "**/image-diff/gm/debug": "^2.6.9"
@@ -346,8 +346,8 @@
     "@types/uuid": "^3.4.4",
     "@types/vinyl-fs": "^2.4.11",
     "@types/zen-observable": "^0.8.0",
-    "@typescript-eslint/eslint-plugin": "^2.5.0",
-    "@typescript-eslint/parser": "^2.5.0",
+    "@typescript-eslint/eslint-plugin": "^2.7.0",
+    "@typescript-eslint/parser": "^2.7.0",
     "angular-mocks": "^1.7.8",
     "archiver": "^3.1.1",
     "axe-core": "^3.3.2",
@@ -444,7 +444,7 @@
     "supertest": "^3.1.0",
     "supertest-as-promised": "^4.0.2",
     "tree-kill": "^1.2.1",
-    "typescript": "3.5.3",
+    "typescript": "3.7.2",
     "typings-tester": "^0.3.2",
     "vinyl-fs": "^3.0.3",
     "xml2js": "^0.4.22",

diff --git a/packages/eslint-config-kibana/package.json b/packages/eslint-config-kibana/package.json
@@ -15,8 +15,8 @@
   },
   "homepage": "https://github.com/elastic/eslint-config-kibana#readme",
   "peerDependencies": {
-    "@typescript-eslint/eslint-plugin": "^2.5.0",
-    "@typescript-eslint/parser": "^2.5.0",
+    "@typescript-eslint/eslint-plugin": "^2.7.0",
+    "@typescript-eslint/parser": "^2.7.0",
     "babel-eslint": "^10.0.3",
     "eslint": "^6.5.1",
     "eslint-plugin-babel": "^5.3.0",

diff --git a/packages/kbn-analytics/package.json b/packages/kbn-analytics/package.json
@@ -17,6 +17,6 @@
     "@babel/cli": "7.5.5",
     "@kbn/dev-utils": "1.0.0",
     "@kbn/babel-preset": "1.0.0",
-    "typescript": "3.5.3"
+    "typescript": "3.7.2"
   }
 }
diff --git a/packages/kbn-config-schema/package.json b/packages/kbn-config-schema/package.json
@@ -10,7 +10,7 @@
     "kbn:bootstrap": "yarn build"
   },
   "devDependencies": {
-    "typescript": "3.5.3"
+    "typescript": "3.7.2"
   },
   "peerDependencies": {
     "joi": "^13.5.2",

diff --git a/packages/kbn-config-schema/src/types/__snapshots__/uri_type.test.ts.snap b/packages/kbn-config-schema/src/types/__snapshots__/uri_type.test.ts.snap
diff --git a/packages/kbn-config-schema/src/types/uri_type.ts b/packages/kbn-config-schema/src/types/uri_type.ts
@@ -36,7 +36,7 @@ export class URIType extends Type<string> {
       case 'string.base':
         return `expected value of type [string] but got [${typeDetect(value)}].`;
       case 'string.uriCustomScheme':
-        return `expected URI with scheme [${scheme}] but but got [${value}].`;
+        return `expected URI with scheme [${scheme}] but got [${value}].`;
       case 'string.uri':
         return `value is [${value}] but it must be a valid URI (see RFC 3986).`;
     }

diff --git a/packages/kbn-dev-utils/package.json b/packages/kbn-dev-utils/package.json
@@ -21,7 +21,7 @@
     "tslib": "^1.9.3"
   },
   "devDependencies": {
-    "typescript": "3.5.3",
+    "typescript": "3.7.2",
     "@kbn/expect": "1.0.0",
     "chance": "1.0.18"
   }

diff --git a/packages/kbn-elastic-idx/package.json b/packages/kbn-elastic-idx/package.json
@@ -20,7 +20,7 @@
     "@babel/core": "^7.5.5",
     "@babel/plugin-transform-async-to-generator": "^7.5.0",
     "jest": "^24.9.0",
-    "typescript": "3.5.3"
+    "typescript": "3.7.2"
   },
   "jest": {
     "testEnvironment": "node"

diff --git a/packages/kbn-i18n/package.json b/packages/kbn-i18n/package.json
@@ -21,7 +21,7 @@
     "del": "^5.1.0",
     "getopts": "^2.2.4",
     "supports-color": "^7.0.0",
-    "typescript": "3.5.3"
+    "typescript": "3.7.2"
   },
   "dependencies": {
     "intl-format-cache": "^2.1.0",

diff --git a/packages/kbn-pm/package.json b/packages/kbn-pm/package.json
@@ -58,7 +58,7 @@
     "strip-ansi": "^4.0.0",
     "strong-log-transformer": "^2.1.0",
     "tempy": "^0.3.0",
-    "typescript": "3.5.3",
+    "typescript": "3.7.2",
     "unlazy-loader": "^0.1.3",
     "webpack": "^4.41.0",
     "webpack-cli": "^3.3.9",

diff --git a/src/core/MIGRATION.md b/src/core/MIGRATION.md
@@ -1130,7 +1130,7 @@ import { setup, start } from '../core_plugins/visualizations/public/legacy';
 | ------------------------------------------------- | ------------------------------------------------------------ | ------------------------------------------------------------------------------------------------------------------------------------------------------------ |
 | `import 'ui/apply_filters'`                       | `import { ApplyFiltersPopover } from '../data/public'`       | `import '../data/public/legacy` should be called to load legacy directives                                                                                   |
 | `import 'ui/filter_bar'`                          | `import { FilterBar } from '../data/public'`                 | `import '../data/public/legacy` should be called to load legacy directives                                                                                   |
-| `import 'ui/query_bar'`                           | `import { QueryBar, QueryBarInput } from '../data/public'`   | Directives are deprecated.                                                                                                                                   |
+| `import 'ui/query_bar'`                           | `import { QueryBarInput } from '../data/public'`   | Directives are deprecated.                                                                                                                                   |
 | `import 'ui/search_bar'`                          | `import { SearchBar } from '../data/public'`                 | Directive is deprecated.                                                                                                                                     |
 | `import 'ui/kbn_top_nav'`                         | `import { TopNavMenu } from '../navigation/public'`          | Directive is still available in `ui/kbn_top_nav`.                                                                                                            |
 | `ui/saved_objects/components/saved_object_finder` | `import { SavedObjectFinder } from '../kibana_react/public'` |                                                                                                                                                              |