Code

Import export#6125

Code

Merged

softwarefactory-project-zuul[bot] merged 73 commits intoansible:develansible/awx:develfrom jbradberry:import-exportCopy head branch name to clipboardJun 19, 2020

+578-10

Commits

Commits on Jun 9, 2020

• Add skeleton of a custom 'export' resource

  Show description for c1f6fec
  jbradberry

  committed
  c1f6fec

  Copy full SHA for c1f6fec

• Normalize the requested resource into a pk

  Show description for 4312395
  jbradberry

  committed
  4312395

  Copy full SHA for 4312395

• Actually query the API for the user or users requested

  jbradberry

  committed
  f21d6b1

  Copy full SHA for f21d6b1

• Limit export output to only those fields needed to create the resource

  jbradberry

  committed
  c1a07ff

  Copy full SHA for c1a07ff

• Add basic import command

  jbradberry

  committed
  9f7fecf

  Copy full SHA for 9f7fecf

• Add organizations as a resource type to export

  jbradberry

  committed
  2127f3c

  Copy full SHA for 2127f3c

• Use a list of exportable resources to build up the parser

  Show description for 9280198
  jbradberry

  committed
  9280198

  Copy full SHA for 9280198

• Split out separate methods for the OPTIONS call and massaging each asset dict

  jbradberry

  committed
  37cbf76

  Copy full SHA for 37cbf76

• Resolve the natural keys of assets we've already collected

  jbradberry

  committed
  dfe3456

  Copy full SHA for dfe3456

• Start to record the role membership

  Show description for 6162ff0
  jbradberry

  committed
  6162ff0

  Copy full SHA for 6162ff0

• Fold the other methods doing API calls into get_assets()

  jbradberry

  committed
  fb066eb

  Copy full SHA for fb066eb

• Make more use of the functionality of Page in get_assets

  Show description for e4383c5
  jbradberry

  committed
  e4383c5

  Copy full SHA for e4383c5

• Modify get_natural_key to work on Pages

  jbradberry

  committed
  0877e53

  Copy full SHA for 0877e53

• Make serialize_asset use Pages to a greater extent

  jbradberry

  committed
  6f28361

  Copy full SHA for 6f28361

• Extract out get_natural_key as a standalone function

  jbradberry

  committed
  372570c

  Copy full SHA for 372570c

• Begin changing Import to work with the structure created by Export

  jbradberry

  committed
  f53920d

  Copy full SHA for f53920d

• Add the calculated natural key to the export data for each asset

  jbradberry

  committed
  21e36ad

  Copy full SHA for 21e36ad

• Begin to deal with existing matching assets

  Show description for 95b22bf
  jbradberry

  committed
  95b22bf

  Copy full SHA for 95b22bf

• Get and assign the related objects

  jbradberry

  committed
  65e16dc

  Copy full SHA for 65e16dc

• Fix a Python 2 syntax error

  Show description for d191edc
  jbradberry

  committed
  d191edc

  Copy full SHA for d191edc

• Only use a default password if an import user doesn't already exist

  jbradberry

  committed
  2c00d42

  Copy full SHA for 2c00d42

• Sort the asset groups to be imported by their dependency relationships

  jbradberry

  committed
  ea5b810

  Copy full SHA for ea5b810

• Temporarily disable export of resources that may not work yet

  jbradberry

  committed
  3f20465

  Copy full SHA for 3f20465

• Filter out managed credential types

  Show description for 868aafb
  jbradberry

  committed
  868aafb

  Copy full SHA for 868aafb

• Create new Import.dependent_resources method

  Show description for d20fa03
  jbradberry

  committed
  d20fa03

  Copy full SHA for d20fa03

• Fix a couple of flaws

  Show description for 55f79a4
  jbradberry

  committed
  55f79a4

  Copy full SHA for 55f79a4

• Enable credential export

  jbradberry

  committed
  ad574eb

  Copy full SHA for ad574eb

• Deal somewhat reasonably with missing fields as part of the natural key

  Show description for 6a9add4
  jbradberry

  committed
  6a9add4

  Copy full SHA for 6a9add4

• Enable notification templates

  jbradberry

  committed
  19c92a7

  Copy full SHA for 19c92a7

• Move the export logic onto methods on the ApiV2 class

  Show description for e4146e9
  jbradberry

  committed
  e4146e9

  Copy full SHA for e4146e9

• Move the import logic into methods on the ApiV2 class

  jbradberry

  committed
  3860c75

  Copy full SHA for 3860c75

• Enable the export of several relation field types

  jbradberry

  committed
  e0f6af4

  Copy full SHA for e0f6af4

• Enable the remaining top-level exportable resources

  Show description for 01d575f
  jbradberry

  committed
  01d575f

  Copy full SHA for 01d575f

• Deal with lack of permissions

  jbradberry

  committed
  30a3e3e

  Copy full SHA for 30a3e3e

• Fix a bug with inventory.variables

  Show description for a1f7d0b
  jbradberry

  committed
  a1f7d0b

  Copy full SHA for a1f7d0b

• Export full related objects under some conditions

  jbradberry

  committed
  972d3ab

  Copy full SHA for 972d3ab

• Enable schedules

  jbradberry

  committed
  07ba521

  Copy full SHA for 07ba521

• Remove the natural key lookup dict and make each Page responsible instead

  jbradberry

  committed
  e92c8cf

  Copy full SHA for e92c8cf

• Tentatively enable inventory sources

  jbradberry

  committed
  329293d

  Copy full SHA for 329293d

• If attempting to link to a resource that is not yet complete, wait

  jbradberry

  committed
  0deacc4

  Copy full SHA for 0deacc4

• Change the NoNaturalKey exception to no longer derive from Common

  Show description for 4262dd3
  jbradberry

  committed
  4262dd3

  Copy full SHA for 4262dd3

• Handle some more bad cases when doing OPTIONS calls

  Show description for e053a58
  jbradberry

  committed
  e053a58

  Copy full SHA for e053a58

• Remove the NoNaturalKey error

  Show description for ab15349
  jbradberry

  committed
  ab15349

  Copy full SHA for ab15349

• Drop objects that cannot be read or do not have a natural key

  Show description for eb10a18
  jbradberry

  committed
  eb10a18

  Copy full SHA for eb10a18

• Fall back to parsing the OPTIONS description

  Show description for a5fa34b
  jbradberry

  committed
  a5fa34b

  Copy full SHA for a5fa34b

• Enable credential relations

  Show description for 719f0b4
  jbradberry

  committed
  719f0b4

  Copy full SHA for 719f0b4

• Enable interconnections between WFJT Nodes

  jbradberry

  committed
  1b26401

  Copy full SHA for 1b26401

• Fix the _create_assets method to use _get_options

  jbradberry

  committed
  385725e

  Copy full SHA for 385725e

• Hook up creation and attachment of related objects

  jbradberry

  committed
  53d81d4

  Copy full SHA for 53d81d4

• Deal with unreadable mandatory foreign keys

  Show description for 43b76f4
  jbradberry

  committed
  43b76f4

  Copy full SHA for 43b76f4

• Remove the $encrypted$ placeholders from export values

  jbradberry

  committed
  6958815

  Copy full SHA for 6958815

• Only wait for Project updates

  Show description for 6387258
  jbradberry

  committed
  6387258

  Copy full SHA for 6387258

• Deal with relations that we cannot resolve

  Show description for 471dc2b
  jbradberry

  committed
  471dc2b

  Copy full SHA for 471dc2b

• Attempt to deal with foreign keys that get mislabeled as type integer

  Show description for 201de4e
  jbradberry

  committed
  201de4e

  Copy full SHA for 201de4e

• Split _get_options into two pieces

  jbradberry

  committed
  bb66e46

  Copy full SHA for bb66e46

• Introduce a new PageCache object

  Show description for 1300d38
  jbradberry

  committed
  1300d38

  Copy full SHA for 1300d38

• Use the new PageCache to store and reuse Page.get results

  jbradberry

  committed
  14b5f63

  Copy full SHA for 14b5f63

• Avoid doing an OPTIONS call unless we know it is a related type we export

  jbradberry

  committed
  f7825ae

  Copy full SHA for f7825ae

• Change the method that exports list views to take a PageList or TentativePage

  Show description for 9fc1a4b
  jbradberry

  committed
  9fc1a4b

  Copy full SHA for 9fc1a4b

• Rename some things for consistency

  jbradberry

  committed
  301f15b

  Copy full SHA for 301f15b

• Reuse _import_list for import of related full objects

  Show description for 66bc947
  jbradberry

  committed
  66bc947

  Copy full SHA for 66bc947

• Log an error and continue when a related object is not found

  jbradberry

  committed
  57aff63

  Copy full SHA for 57aff63

• Make more use of the PageCache for imports

  jbradberry

  committed
  86afa5c

  Copy full SHA for 86afa5c

• Redo waiting until Project updates are complete

  jbradberry

  committed
  a531b85

  Copy full SHA for a531b85

• Deal with exports involving foreign keys where you don't have permission

  jbradberry

  committed
  76fb605

  Copy full SHA for 76fb605

• Make sure we have a cached version of existing objects

  Show description for c8288af
  jbradberry

  committed
  c8288af

  Copy full SHA for c8288af

• Recursively queue up related assets to be created and/or assigned

  jbradberry

  committed
  65fc2db

  Copy full SHA for 65fc2db

• Fix WFJT nodes endpoint to return node pages when posting

  Show description for 1f7c1af
  jbradberry

  committed
  1f7c1af

  Copy full SHA for 1f7c1af

• Add more logging

  jbradberry

  committed
  aeeed4d

  Copy full SHA for aeeed4d

• Return the changed status of imports

  jbradberry

  committed
  19b7c91

  Copy full SHA for 19b7c91

Commits on Jun 10, 2020

• Prioritize membership roles

  Show description for bf6e8f8
  jbradberry

  committed
  bf6e8f8

  Copy full SHA for bf6e8f8

Commits on Jun 11, 2020

• Continue after failures to grant roles

  jbradberry

  committed
  0fda9d2

  Copy full SHA for 0fda9d2

Commits on Jun 18, 2020

• First cut at examples of the import and export commands

  jbradberry

  committed
  393369a

  Copy full SHA for 393369a