Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Not enough information about migration failure in upgrade assistant #116699

Closed
bhavyarm opened this issue Oct 28, 2021 · 2 comments
Closed

Not enough information about migration failure in upgrade assistant #116699

bhavyarm opened this issue Oct 28, 2021 · 2 comments
Labels
bug Fixes for quality problems that affect the customer experience Feature:Upgrade Assistant Team:Kibana Management Dev Tools, Index Management, Upgrade Assistant, ILM, Ingest Node Pipelines, and more

Comments

@bhavyarm
Copy link
Contributor

Kibana version: 7.16.0 BC2

Elasticsearch version: 7.16.0 BC2

Server OS version: darwin_x86_64

Browser version: chrome latest

Browser OS version: OS X

Original install method (e.g. download page, yum, from source, etc.): from staging

Describe the bug: I upgraded my cluster from 6.8.20->7.12.1->7.16.0 in preparation for upgrading to 8.0.0 beta1.
While running through steps in upgrade assistant - migrate indices - I have System indices migration failed without much details.

Upgrade assistant is displaying - and no other details in the call out panel for "View Migration Details"

An error ocurred while migrating system indices for kibana: mapper_parsing_exception

Screen Shot 2021-10-28 at 10 28 43 AM

ES Logs:

[2021-10-28T11:48:27,803][INFO ][o.e.c.m.MetadataCreateIndexService] [Bhavyas-MacBook-Pro.local] failed on parsing mappings on index creation [.kibana_1-reindexed-for-8]
org.elasticsearch.index.mapper.MapperParsingException: Failed to parse mapping [_doc]: Root mapping definition has unsupported parameters:  [doc : {dynamic=strict, properties={ml-telemetry={properties={file_data_visualizer={properties={index_creation_count={type=long}}}}}, server={properties={uuid={type=keyword}}}, visualization={properties={savedSearchId={type=keyword}, description={type=text}, uiStateJSON={type=text}, title={type=text}, version={type=integer}, kibanaSavedObjectMeta={properties={searchSourceJSON={type=text}}}, visState={type=text}}}, apm-telemetry={properties={has_any_services={type=boolean}, services_per_agent={properties={python={null_value=0, type=long}, java={null_value=0, type=long}, go={null_value=0, type=long}, nodejs={null_value=0, type=long}, js-base={null_value=0, type=long}, ruby={null_value=0, type=long}}}}}, graph-workspace={properties={numVertices={type=integer}, description={type=text}, numLinks={type=integer}, title={type=text}, version={type=integer}, kibanaSavedObjectMeta={properties={searchSourceJSON={type=text}}}, wsState={type=text}}}, kql-telemetry={properties={optInCount={type=long}, optOutCount={type=long}}}, type={type=keyword}, infrastructure-ui-source={properties={logAlias={type=keyword}, metricAlias={type=keyword}, name={type=text}, description={type=text}, fields={properties={container={type=keyword}, pod={type=keyword}, host={type=keyword}, tiebreaker={type=keyword}, timestamp={type=keyword}}}}}, space={properties={color={type=keyword}, _reserved={type=boolean}, initials={type=keyword}, name={type=text, fields={keyword={ignore_above=2048, type=keyword}}}, description={type=text}}}, url={properties={accessCount={type=long}, accessDate={type=date}, url={type=text, fields={keyword={ignore_above=2048, type=keyword}}}, createDate={type=date}}}, migrationVersion={dynamic=true, properties={index-pattern={type=text, fields={keyword={ignore_above=256, type=keyword}}}, visualization={type=text, fields={keyword={ignore_above=256, type=keyword}}}}}, index-pattern={properties={notExpandable={type=boolean}, fieldFormatMap={type=text}, sourceFilters={type=text}, typeMeta={type=keyword}, timeFieldName={type=keyword}, intervalName={type=keyword}, fields={type=text}, title={type=text}, type={type=keyword}}}, upgrade-assistant-reindex-operation={dynamic=true, properties={indexName={type=keyword}, status={type=integer}}}, search={properties={hits={type=integer}, columns={type=keyword}, description={type=text}, sort={type=keyword}, title={type=text}, version={type=integer}, kibanaSavedObjectMeta={properties={searchSourceJSON={type=text}}}}}, updated_at={type=date}, canvas-workpad={dynamic=false, properties={@created={type=date}, @timestamp={type=date}, name={type=text, fields={keyword={type=keyword}}}, id={index=false, type=text}}}, maps-telemetry={properties={mapsTotalCount={type=long}, attributesPerMap={properties={emsVectorLayersCount={dynamic=true, type=object}, layerTypesCount={dynamic=true, type=object}, dataSourcesCount={properties={avg={type=long}, min={type=long}, max={type=long}}}, layersCount={properties={avg={type=long}, min={type=long}, max={type=long}}}}}, timeCaptured={type=date}}}, namespace={type=keyword}, telemetry={properties={enabled={type=boolean}}}, timelion-sheet={properties={hits={type=integer}, timelion_sheet={type=text}, timelion_interval={type=keyword}, timelion_columns={type=integer}, timelion_other_interval={type=keyword}, timelion_rows={type=integer}, description={type=text}, title={type=text}, version={type=integer}, kibanaSavedObjectMeta={properties={searchSourceJSON={type=text}}}, timelion_chart_height={type=integer}}}, config={dynamic=true, properties={buildNum={type=keyword}, defaultIndex={type=text, fields={keyword={ignore_above=256, type=keyword}}}}}, map={properties={bounds={type=geo_shape}, mapStateJSON={type=text}, description={type=text}, layerListJSON={type=text}, uiStateJSON={type=text}, title={type=text}, version={type=integer}}}, dashboard={properties={hits={type=integer}, timeFrom={type=keyword}, timeTo={type=keyword}, refreshInterval={properties={display={type=keyword}, section={type=integer}, value={type=integer}, pause={type=boolean}}}, description={type=text}, uiStateJSON={type=text}, timeRestore={type=boolean}, title={type=text}, version={type=integer}, kibanaSavedObjectMeta={properties={searchSourceJSON={type=text}}}, optionsJSON={type=text}, panelsJSON={type=text}}}, upgrade-assistant-telemetry={properties={features={properties={deprecation_logging={properties={enabled={null_value=true, type=boolean}}}}}, ui_open={properties={cluster={null_value=0, type=long}, overview={null_value=0, type=long}, indices={null_value=0, type=long}}}, ui_reindex={properties={stop={null_value=0, type=long}, start={null_value=0, type=long}, close={null_value=0, type=long}, open={null_value=0, type=long}}}}}}}]
	at org.elasticsearch.index.mapper.MapperService.parseMappings(MapperService.java:436) ~[elasticsearch-7.16.0.jar:7.16.0]
	at org.elasticsearch.index.mapper.MapperService.mergeAndApplyMappings(MapperService.java:352) ~[elasticsearch-7.16.0.jar:7.16.0]
	at org.elasticsearch.index.mapper.MapperService.merge(MapperService.java:335) ~[elasticsearch-7.16.0.jar:7.16.0]
	at org.elasticsearch.cluster.metadata.MetadataCreateIndexService.updateIndexMappingsAndBuildSortOrder(MetadataCreateIndexService.java:1109) ~[elasticsearch-7.16.0.jar:7.16.0]
	at org.elasticsearch.cluster.metadata.MetadataCreateIndexService.lambda$applyCreateIndexWithTemporaryService$3(MetadataCreateIndexService.java:424) [elasticsearch-7.16.0.jar:7.16.0]
	at org.elasticsearch.indices.IndicesService.withTempIndexService(IndicesService.java:632) [elasticsearch-7.16.0.jar:7.16.0]
	at org.elasticsearch.cluster.metadata.MetadataCreateIndexService.applyCreateIndexWithTemporaryService(MetadataCreateIndexService.java:422) [elasticsearch-7.16.0.jar:7.16.0]
	at org.elasticsearch.cluster.metadata.MetadataCreateIndexService.applyCreateIndexRequestWithV1Templates(MetadataCreateIndexService.java:509) [elasticsearch-7.16.0.jar:7.16.0]
	at org.elasticsearch.cluster.metadata.MetadataCreateIndexService.applyCreateIndexRequest(MetadataCreateIndexService.java:385) [elasticsearch-7.16.0.jar:7.16.0]
	at org.elasticsearch.cluster.metadata.MetadataCreateIndexService.applyCreateIndexRequest(MetadataCreateIndexService.java:392) [elasticsearch-7.16.0.jar:7.16.0]
	at org.elasticsearch.cluster.metadata.MetadataCreateIndexService$1.execute(MetadataCreateIndexService.java:309) [elasticsearch-7.16.0.jar:7.16.0]
	at org.elasticsearch.cluster.ClusterStateUpdateTask.execute(ClusterStateUpdateTask.java:48) [elasticsearch-7.16.0.jar:7.16.0]
	at org.elasticsearch.cluster.service.MasterService.executeTasks(MasterService.java:751) [elasticsearch-7.16.0.jar:7.16.0]
	at org.elasticsearch.cluster.service.MasterService.calculateTaskOutputs(MasterService.java:366) [elasticsearch-7.16.0.jar:7.16.0]
	at org.elasticsearch.cluster.service.MasterService.runTasks(MasterService.java:229) [elasticsearch-7.16.0.jar:7.16.0]
	at org.elasticsearch.cluster.service.MasterService.access$100(MasterService.java:63) [elasticsearch-7.16.0.jar:7.16.0]
	at org.elasticsearch.cluster.service.MasterService$Batcher.run(MasterService.java:161) [elasticsearch-7.16.0.jar:7.16.0]
	at org.elasticsearch.cluster.service.TaskBatcher.runIfNotProcessed(TaskBatcher.java:135) [elasticsearch-7.16.0.jar:7.16.0]
	at org.elasticsearch.cluster.service.TaskBatcher$BatchedTask.run(TaskBatcher.java:192) [elasticsearch-7.16.0.jar:7.16.0]
	at org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:678) [elasticsearch-7.16.0.jar:7.16.0]
	at org.elasticsearch.common.util.concurrent.PrioritizedEsThreadPoolExecutor$TieBreakingPrioritizedRunnable.runAndClean(PrioritizedEsThreadPoolExecutor.java:259) [elasticsearch-7.16.0.jar:7.16.0]
	at org.elasticsearch.common.util.concurrent.PrioritizedEsThreadPoolExecutor$TieBreakingPrioritizedRunnable.run(PrioritizedEsThreadPoolExecutor.java:222) [elasticsearch-7.16.0.jar:7.16.0]
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) [?:?]
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) [?:?]
	at java.lang.Thread.run(Thread.java:833) [?:?]
@bhavyarm bhavyarm added bug Fixes for quality problems that affect the customer experience Team:Kibana Management Dev Tools, Index Management, Upgrade Assistant, ILM, Ingest Node Pipelines, and more Feature:Upgrade Assistant labels Oct 28, 2021
@elasticmachine
Copy link
Contributor

Pinging @elastic/kibana-stack-management (Team:Stack Management)

@liza-mae
Copy link
Contributor

Duplicate of #116209 which lists the open issues in this area via comment #116209 (comment)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Fixes for quality problems that affect the customer experience Feature:Upgrade Assistant Team:Kibana Management Dev Tools, Index Management, Upgrade Assistant, ILM, Ingest Node Pipelines, and more
Projects
None yet
Development

No branches or pull requests

3 participants