Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Calm-DSL changes for Calm v3.4.0 #222

Merged
merged 57 commits into from
Mar 22, 2022
Merged

Conversation

abhijeetkaurav1st
Copy link
Collaborator

@abhijeetkaurav1st abhijeetkaurav1st commented Mar 21, 2022

The review consists of DSL changes for Calm 3.4.0

tayalakansh and others added 30 commits March 13, 2022 11:55
* added jobs jinja template

* added way to create job via dsl

* added create_job method

* created scheduleinfo as separate class

* added recurring job support

* added recurring job test file

* changed class names of test files

* added description field to schema

* enabled discription field in payload

* fixed indentations

* added test

* added test for recurring job

* fixed formatting

* removed skip exec and state from input py files

* use exception instead of logger for connection errors

* test fixes

* revert back to log.error in connection.py file

* change log.dubug to log.info

* fixed py file path in test

* fixed dsl file paths

* remove unused imports

* added variable_list

* handled runtime editables

* formating changes

* added test to check if job create fails in case invalid start date is passed

* formatting changes

* added negative tests for job create api

* formatting changes

* directly call runbook method in test

* formatting fix

* added negative tests

* added test in which expiry date is less than current date

* formatting changes

* added unicode test

* formatting changes

* use current date to pass start and expiry date

* check for status and error messages in test

* formatting changes

* added test to check duplicate name of jobs

* test changes

* formatting changes

* pass job name as a random string in tests

* formatting changes

* added list and describle job commands

* added tests for get and list apis

* added py files used in job get and list api tests

* fixed null pointer exception if default endpoint doesnt exist in runbook for describe command

* added job instances list command

* added scheduler test and enabled filtering for job instances

* added scheduler test for one time job

* file renamed

* test changes

* renaming files

* renamed files

* fixed runbook name fetching

* renaming files

* added files

* added xfail marker

* black related formatting fixes

* black related formatting fixes

* Revert "black related formatting fixes"

This reverts commit 16202f869a93a847851d658993275cfbde07fe3f.

* black formatting changes

* addressed review comments

* black formatting fix

* added decision task runbook py file which is used in tests

Co-authored-by: abhijeetkaurav1st <[email protected]>
(cherry picked from commit 2e19651c0032087d518b490903175ab691f5f221)
(cherry picked from commit d3a305fcaddb1bfe1ce864eeed7de3094824a01d)
(cherry picked from commit b1e204d2bb041589698cfbd945ae76d821d013d5)
Summary of changes - https://docs.google.com/document/d/1Ams2OqjtOf74LYf5IwTAnAsyCpcrft6ydPGi0DrZztE/edit?pli=1#heading=h.8n3rtdfbxnjx

Co-authored-by: Santhosh.Vijayan <[email protected]>
Co-authored-by: abhijeetkaurav1st <[email protected]>
(cherry picked from commit 26df94827a16b18e043cb582f6ccc70a043bece0)
(cherry picked from commit fb8e878f9c46a2fb4185bb61b18ac97ca8aad7c5)
(cherry picked from commit 97d8bbe3e615cc3a36a7e3b2462320f7e0f5751a)
(cherry picked from commit 97a11fd3219faf940f92fe65d53f2d22b73f3b9a)
(cherry picked from commit d4c25cce43ffab7464e3af641359d33f954cdab1)
(cherry picked from commit 988f6aa5abd0412e90cc56a5a9bc4f905b06b3f3)
(cherry picked from commit 604569ea2971b97fa7374d0f09d074aecaf5a442)
* added support for scheduling app actions

* added recurring job app action py file

* added scheduler tests for app actions

* Rename messages to message_list for scheduler APIs

* added support for delete and soft delete actions in scheduler via dsl

* fixed snapshot restore action scheduling

* black related formatting fixes

* timezone changes

* black formatting fixes

* changed to datetime.now()

Co-authored-by: Kiran Shenoy <[email protected]>
(cherry picked from commit bb5927b2878573e0ee3765ece773a52e2e58ca80)
* recovery point changes for bps

* Adding api changes

* Adding get commands

* Adding final validations and substrate fixes for vm_recovery_spec

* Adding tests for recovery point bp launches

* Minor fix

* Minor fix in substrate

* Fix serial_port_list for ahv_vm.py

* Adding minor log

* Added catch to check exception

* Minor fix

* Test fix

* Test fix

* Fixing network name in test blueprint

(cherry picked from commit 0e87ae9c6d6837cf4140f145ebb6a389a9b0b1fe)
…test

(cherry picked from commit 78d1c5d76ca645fc1116513590dd25b8d339269f)
* initial commit for app edit -> parts taken from ideadevice/calm-dsl#19

* lint fix

* lint fix

* lint fix

* fixes

* import fix

* remove extra file

* fix app edit dsl

* add example

* test

* bring in some structure

* del

* remove extra

* fixed example

* revert extra changes

* fixes

* lint

* minor change

* cleanup 1

* cleanup 2

* cleanup 3

* lint

* make patch run work

* lint

* list patches in app describe

* review comments and fixes

* fix

* add patch handler

* change to update config

* some more fixes

* some more fixes

* make update like sys action

* fixed nic example

* fix disk add

* added helper class

* initial class structure

* make nic del work

* add for category and fixed some bugs

* add min level

* add min version in profile also

* Add skip/modify/delete prompt

* extract prompt function

* Interactively modify patch payload for app edit

* extract prompt functions

* set min/max based on operation

* exclude nics and disks in use while deleting

* comment out (unnecessary?) parts

* format changes

* remove unnecessary comments

* remove patch_editables parameter

* change name for UpdateConfigAttrs to AhvUpdateConfigAttrs

* fix

* fix

* fix

* change compile to get_user_attrs

* change validator

* ipdb

* fix

* disk and nic

* changes

* fix

* fix

* parse patch editables from file input non-interactively

* handle file editables for multiple attrs

* fix delete operations

* add disk and category addition logic

* fix nic delete operation

* Add logs for editables parsed through file

* Fix mistakes in comments and logs

* Add updating status to app describe command

* Use global update command instead of overriding

* Add ignore_runtime_variables flag

* Add test for ahv patch editables

* Change nic source from config file

* Use nic name instead of cluster and nic name

* move wait for states func to helper class

* Add section headings while interactively editing variables

* remove nic delete from bp in test

* Add more information about editables during interaction

* fix tests

* Formatting changes

* fix snapshot restore test

* Run formatter

* move logic to compile

* add default values

* fix

* fix empty patch attrs

* fix

* fix

* remove unwanted file

* adding test cases for app edit feat

* adding disk operations to the patach

* adding validations to the test cases

* Minor fix in tests

* adding disk delete and disk modify operations to the patch

* changeng nic value

* add release notes

* add release notes

* removing breakpoints

* add release notes

Co-authored-by: Shreevari SP <[email protected]>
Co-authored-by: Shreevari SP <[email protected]>
Co-authored-by: anilkumarkondeti <[email protected]>
Co-authored-by: abhijeetkaurav1st <[email protected]>
Co-authored-by: anilkumarkondeti <[email protected]>
(cherry picked from commit fc31c5cc161f30e64ea2eae327b2f80d25d6de14)
commit e5d97b4
Merge: a704367 36dfaf1
Author: Abhijeet Singh Kaurav <[email protected]>
Date:   Mon Nov 8 19:29:36 2021 +0530

    Merge pull request #198 from nutanix/release/3.3.0

    Changes for Calm v3.3.0

commit 36dfaf1
Merge: a704367 95bb44e
Author: abhijeetkaurav1st <[email protected]>
Date:   Mon Nov 8 14:15:09 2021 +0530

    Merge branch 'release/3.3.0' of github.com:ideadevice/calm-dsl into release/3.3.0

commit 95bb44e
Author: abhijeetkaurav1st <[email protected]>
Date:   Mon Nov 8 09:50:18 2021 +0530

    Fixing some brownfield and env fixes

commit 4797f32
Author: abhijeetkaurav1st <[email protected]>
Date:   Wed Nov 3 22:46:10 2021 +0530

    Black format

commit 3de448f
Author: abhijeetkaurav1st <[email protected]>
Date:   Wed Nov 3 22:35:31 2021 +0530

    Minor fixes regarding release-notes and some command name fixes

commit 370c975
Author: gaurav <[email protected]>
Date:   Tue Nov 2 23:35:22 2021 +0530

    App edit DSL support (#43) (#92)

    * initial commit for app edit -> parts taken from ideadevice/calm-dsl#19

    * lint fix

    * lint fix

    * lint fix

    * fixes

    * import fix

    * remove extra file

    * fix app edit dsl

    * add example

    * test

    * bring in some structure

    * del

    * remove extra

    * fixed example

    * revert extra changes

    * fixes

    * lint

    * minor change

    * cleanup 1

    * cleanup 2

    * cleanup 3

    * lint

    * make patch run work

    * lint

    * list patches in app describe

    * review comments and fixes

    * fix

    * add patch handler

    * change to update config

    * some more fixes

    * some more fixes

    * make update like sys action

    * fixed nic example

    * fix disk add

    * added helper class

    * initial class structure

    * make nic del work

    * add for category and fixed some bugs

    * add min level

    * add min version in profile also

    * Add skip/modify/delete prompt

    * extract prompt function

    * Interactively modify patch payload for app edit

    * extract prompt functions

    * set min/max based on operation

    * exclude nics and disks in use while deleting

    * comment out (unnecessary?) parts

    * format changes

    * remove unnecessary comments

    * remove patch_editables parameter

    * change name for UpdateConfigAttrs to AhvUpdateConfigAttrs

    * fix

    * fix

    * fix

    * change compile to get_user_attrs

    * change validator

    * ipdb

    * fix

    * disk and nic

    * changes

    * fix

    * fix

    * parse patch editables from file input non-interactively

    * handle file editables for multiple attrs

    * fix delete operations

    * add disk and category addition logic

    * fix nic delete operation

    * Add logs for editables parsed through file

    * Fix mistakes in comments and logs

    * Add updating status to app describe command

    * Use global update command instead of overriding

    * Add ignore_runtime_variables flag

    * Add test for ahv patch editables

    * Change nic source from config file

    * Use nic name instead of cluster and nic name

    * move wait for states func to helper class

    * Add section headings while interactively editing variables

    * remove nic delete from bp in test

    * Add more information about editables during interaction

    * fix tests

    * Formatting changes

    * fix snapshot restore test

    * Run formatter

    * move logic to compile

    * add default values

    * fix

    * fix empty patch attrs

    * fix

    * fix

    * remove unwanted file

    * adding test cases for app edit feat

    * adding disk operations to the patach

    * adding validations to the test cases

    * Minor fix in tests

    * adding disk delete and disk modify operations to the patch

    * changeng nic value

    * add release notes

    * add release notes

    * removing breakpoints

    * add release notes

    Co-authored-by: Shreevari SP <[email protected]>
    Co-authored-by: Shreevari SP <[email protected]>
    Co-authored-by: anilkumarkondeti <[email protected]>
    Co-authored-by: abhijeetkaurav1st <[email protected]>
    Co-authored-by: anilkumarkondeti <[email protected]>

    Co-authored-by: Shreevari SP <[email protected]>
    Co-authored-by: Shreevari SP <[email protected]>
    Co-authored-by: anilkumarkondeti <[email protected]>
    Co-authored-by: abhijeetkaurav1st <[email protected]>
    Co-authored-by: anilkumarkondeti <[email protected]>

commit ba9b246
Author: Mayank Choudhary <[email protected]>
Date:   Tue Nov 2 23:17:59 2021 +0530

    snapshot-restore release notes for 3.3.0 (#75) (#91)

    * snapshot-restore release notes

    * add link to bp example

commit 469fd80
Author: Pradeepsingh Bhati <[email protected]>
Date:   Fri Oct 22 18:36:01 2021 +0530

    Add interface and implementations for aws provider specific api object for different calm versions. (#78) (#88)

    * 1. Add interface for aws provider specific api
    2. Add/restructure implementation of aws api object for different calm versions

    * Reformatting files

    * Reformat import statements

    * Reformatting files(black)

    * Fix version number for aws provider spec object

commit a704367
Author: abhijeetkaurav1st <[email protected]>
Date:   Thu Oct 21 09:18:34 2021 +0530

commit b4162cd
Merge: f68e3eb 905fce3
Author: Abhijeet Singh Kaurav <[email protected]>
Date:   Sun Oct 17 20:43:35 2021 +0530

    Merge pull request #85 from ideadevice/task/3.3.0-cherrypick-calm-20742-changes

    Task/3.3.0 cherrypick calm 20742 changes

commit 905fce3
Author: Abhijeet Singh Kaurav <[email protected]>
Date:   Sun Oct 17 12:59:12 2021 +0530

    Task/m calm 20742 vm recovery point changes (#76)

    * recovery point changes for bps

    * Adding api changes

    * Adding get commands

    * Adding final validations and substrate fixes for vm_recovery_spec

    * Adding tests for recovery point bp launches

    * Minor fix

    * Minor fix in substrate

    * Fix serial_port_list for ahv_vm.py

    * Adding minor log

    * Added catch to check exception

    * Minor fix

    * Test fix

    * Test fix

    * Fixing network name in test blueprint

commit 4d4da6b
Author: abhijeetkaurav1st <[email protected]>
Date:   Wed Sep 15 16:15:46 2021 +0530

    Skipping runbook test due to CALM-27162

commit fef58ac
Author: Abhijeet Singh Kaurav <[email protected]>
Date:   Mon Sep 13 12:08:30 2021 +0530

    Using common helper for waiting for non-busy state (#71)

    * Using common helper for waiting for non-busy state

    * Minor fix

commit b90e676
Author: abhijeetkaurav1st <[email protected]>
Date:   Thu Sep 30 15:20:27 2021 +0530

    Fixing groups helper for caps name and update project using cli switch

commit f68e3eb
Author: anilkumarkondeti <[email protected]>
Date:   Thu Sep 9 18:10:54 2021 +0530

    ignoring VPC subnets (#70) (#74)

commit a6ce146
Author: Pradeepsingh Bhati <[email protected]>
Date:   Thu Sep 9 17:59:22 2021 +0530

    Fix template_id issue when there is no template for vmware create spec (#72) (#73)

    * Fix template_id issue when there is no template for vmware create spec

    * Reformatting

commit 979aa37
Author: Mayank Choudhary <[email protected]>
Date:   Wed Sep 1 16:13:01 2021 +0530

    fix expiry type in cache (#66) (#67)

commit 5c9395e
Author: Mayank Choudhary <[email protected]>
Date:   Wed Sep 1 13:29:20 2021 +0530

    safety checks for protection rule expiry (#64) (#65)

    * safety checks for protection rule expiry

    * safety checks for protection rule expiry while updating cache

commit 8ad8e08
Author: Mayank Choudhary <[email protected]>
Date:   Mon Aug 23 16:59:02 2021 +0530

    protection policy fixes (#60) (#62)

    - #CALM-27047, #CALM-27044 and #CALM-27046

commit 95f3390
Author: Abhijeet Singh Kaurav <[email protected]>
Date:   Thu Aug 19 17:54:43 2021 +0530

    Substrate changes for sending account_uuid for ahv_substrates (#56) (#61)

    * Substrate changes, so that correct account_uuid is supplied while creating/compiling blueprint with ahv provider

    * Fixing logic to not use nic.compile() at substrate compile as it involves parent reference

    * Fixing tcs as per latest changes

    * Minor fix when cluster name is not same as cluster account name.

    * Fixing snapshot restore compile test

commit cc3fdb4
Author: Abhijeet Singh Kaurav <[email protected]>
Date:   Thu Aug 19 09:50:20 2021 +0530

    Task/m calm 27024 runbook containing durga macros (#58) (#59)

    * Add runbbok containing all macros and test for it

    * minor fix

    * make black

    * Adding todo  task

commit 24c616a
Author: Mayank Choudhary <[email protected]>
Date:   Tue Aug 17 13:47:23 2021 +0530

    Topic/m multivm snapshot changes calm 18417 (#57)

    Summary of changes - https://docs.google.com/document/d/1Ams2OqjtOf74LYf5IwTAnAsyCpcrft6ydPGi0DrZztE/edit?pli=1#heading=h.8n3rtdfbxnjx

     Conflicts:
    	calm/dsl/api/handle.py
    	calm/dsl/builtins/__init__.py
    	calm/dsl/cli/__init__.py
    	calm/dsl/db/table_config.py

(cherry picked from commit c32f9ec877a7bf758d86f42ea3dbb957c38c0ac1)
commit 6586409
Author: abhijeetkaurav1st <[email protected]>
Date:   Tue Nov 9 12:17:02 2021 +0530

    Fixing readme/examples for disk-delete in app-edit

commit 547dea1
Author: abhijeetkaurav1st <[email protected]>
Date:   Tue Nov 9 10:09:15 2021 +0530

    Fixing links in release-notes

commit e5d97b4
Merge: a704367 36dfaf1
Author: Abhijeet Singh Kaurav <[email protected]>
Date:   Mon Nov 8 19:29:36 2021 +0530

    Merge pull request #198 from nutanix/release/3.3.0

    Changes for Calm v3.3.0

commit 36dfaf1
Merge: a704367 95bb44e
Author: abhijeetkaurav1st <[email protected]>
Date:   Mon Nov 8 14:15:09 2021 +0530

    Merge branch 'release/3.3.0' of github.com:ideadevice/calm-dsl into release/3.3.0

commit 95bb44e
Author: abhijeetkaurav1st <[email protected]>
Date:   Mon Nov 8 09:50:18 2021 +0530

    Fixing some brownfield and env fixes

commit 4797f32
Author: abhijeetkaurav1st <[email protected]>
Date:   Wed Nov 3 22:46:10 2021 +0530

    Black format

commit 3de448f
Author: abhijeetkaurav1st <[email protected]>
Date:   Wed Nov 3 22:35:31 2021 +0530

    Minor fixes regarding release-notes and some command name fixes

commit 370c975
Author: gaurav <[email protected]>
Date:   Tue Nov 2 23:35:22 2021 +0530

    App edit DSL support (#43) (#92)

    * initial commit for app edit -> parts taken from ideadevice/calm-dsl#19

    * lint fix

    * lint fix

    * lint fix

    * fixes

    * import fix

    * remove extra file

    * fix app edit dsl

    * add example

    * test

    * bring in some structure

    * del

    * remove extra

    * fixed example

    * revert extra changes

    * fixes

    * lint

    * minor change

    * cleanup 1

    * cleanup 2

    * cleanup 3

    * lint

    * make patch run work

    * lint

    * list patches in app describe

    * review comments and fixes

    * fix

    * add patch handler

    * change to update config

    * some more fixes

    * some more fixes

    * make update like sys action

    * fixed nic example

    * fix disk add

    * added helper class

    * initial class structure

    * make nic del work

    * add for category and fixed some bugs

    * add min level

    * add min version in profile also

    * Add skip/modify/delete prompt

    * extract prompt function

    * Interactively modify patch payload for app edit

    * extract prompt functions

    * set min/max based on operation

    * exclude nics and disks in use while deleting

    * comment out (unnecessary?) parts

    * format changes

    * remove unnecessary comments

    * remove patch_editables parameter

    * change name for UpdateConfigAttrs to AhvUpdateConfigAttrs

    * fix

    * fix

    * fix

    * change compile to get_user_attrs

    * change validator

    * ipdb

    * fix

    * disk and nic

    * changes

    * fix

    * fix

    * parse patch editables from file input non-interactively

    * handle file editables for multiple attrs

    * fix delete operations

    * add disk and category addition logic

    * fix nic delete operation

    * Add logs for editables parsed through file

    * Fix mistakes in comments and logs

    * Add updating status to app describe command

    * Use global update command instead of overriding

    * Add ignore_runtime_variables flag

    * Add test for ahv patch editables

    * Change nic source from config file

    * Use nic name instead of cluster and nic name

    * move wait for states func to helper class

    * Add section headings while interactively editing variables

    * remove nic delete from bp in test

    * Add more information about editables during interaction

    * fix tests

    * Formatting changes

    * fix snapshot restore test

    * Run formatter

    * move logic to compile

    * add default values

    * fix

    * fix empty patch attrs

    * fix

    * fix

    * remove unwanted file

    * adding test cases for app edit feat

    * adding disk operations to the patach

    * adding validations to the test cases

    * Minor fix in tests

    * adding disk delete and disk modify operations to the patch

    * changeng nic value

    * add release notes

    * add release notes

    * removing breakpoints

    * add release notes

    Co-authored-by: Shreevari SP <[email protected]>
    Co-authored-by: Shreevari SP <[email protected]>
    Co-authored-by: anilkumarkondeti <[email protected]>
    Co-authored-by: abhijeetkaurav1st <[email protected]>
    Co-authored-by: anilkumarkondeti <[email protected]>

    Co-authored-by: Shreevari SP <[email protected]>
    Co-authored-by: Shreevari SP <[email protected]>
    Co-authored-by: anilkumarkondeti <[email protected]>
    Co-authored-by: abhijeetkaurav1st <[email protected]>
    Co-authored-by: anilkumarkondeti <[email protected]>

commit ba9b246
Author: Mayank Choudhary <[email protected]>
Date:   Tue Nov 2 23:17:59 2021 +0530

    snapshot-restore release notes for 3.3.0 (#75) (#91)

    * snapshot-restore release notes

    * add link to bp example

commit 469fd80
Author: Pradeepsingh Bhati <[email protected]>
Date:   Fri Oct 22 18:36:01 2021 +0530

    Add interface and implementations for aws provider specific api object for different calm versions. (#78) (#88)

    * 1. Add interface for aws provider specific api
    2. Add/restructure implementation of aws api object for different calm versions

    * Reformatting files

    * Reformat import statements

    * Reformatting files(black)

    * Fix version number for aws provider spec object

commit a704367
Author: abhijeetkaurav1st <[email protected]>
Date:   Thu Oct 21 09:18:34 2021 +0530

commit b4162cd
Merge: f68e3eb 905fce3
Author: Abhijeet Singh Kaurav <[email protected]>
Date:   Sun Oct 17 20:43:35 2021 +0530

    Merge pull request #85 from ideadevice/task/3.3.0-cherrypick-calm-20742-changes

    Task/3.3.0 cherrypick calm 20742 changes

commit 905fce3
Author: Abhijeet Singh Kaurav <[email protected]>
Date:   Sun Oct 17 12:59:12 2021 +0530

    Task/m calm 20742 vm recovery point changes (#76)

    * recovery point changes for bps

    * Adding api changes

    * Adding get commands

    * Adding final validations and substrate fixes for vm_recovery_spec

    * Adding tests for recovery point bp launches

    * Minor fix

    * Minor fix in substrate

    * Fix serial_port_list for ahv_vm.py

    * Adding minor log

    * Added catch to check exception

    * Minor fix

    * Test fix

    * Test fix

    * Fixing network name in test blueprint

commit 4d4da6b
Author: abhijeetkaurav1st <[email protected]>
Date:   Wed Sep 15 16:15:46 2021 +0530

    Skipping runbook test due to CALM-27162

commit fef58ac
Author: Abhijeet Singh Kaurav <[email protected]>
Date:   Mon Sep 13 12:08:30 2021 +0530

    Using common helper for waiting for non-busy state (#71)

    * Using common helper for waiting for non-busy state

    * Minor fix

commit b90e676
Author: abhijeetkaurav1st <[email protected]>
Date:   Thu Sep 30 15:20:27 2021 +0530

    Fixing groups helper for caps name and update project using cli switch

commit f68e3eb
Author: anilkumarkondeti <[email protected]>
Date:   Thu Sep 9 18:10:54 2021 +0530

    ignoring VPC subnets (#70) (#74)

commit a6ce146
Author: Pradeepsingh Bhati <[email protected]>
Date:   Thu Sep 9 17:59:22 2021 +0530

    Fix template_id issue when there is no template for vmware create spec (#72) (#73)

    * Fix template_id issue when there is no template for vmware create spec

    * Reformatting

commit 979aa37
Author: Mayank Choudhary <[email protected]>
Date:   Wed Sep 1 16:13:01 2021 +0530

    fix expiry type in cache (#66) (#67)

commit 5c9395e
Author: Mayank Choudhary <[email protected]>
Date:   Wed Sep 1 13:29:20 2021 +0530

    safety checks for protection rule expiry (#64) (#65)

    * safety checks for protection rule expiry

    * safety checks for protection rule expiry while updating cache

commit 8ad8e08
Author: Mayank Choudhary <[email protected]>
Date:   Mon Aug 23 16:59:02 2021 +0530

    protection policy fixes (#60) (#62)

    - #CALM-27047, #CALM-27044 and #CALM-27046

commit 95f3390
Author: Abhijeet Singh Kaurav <[email protected]>
Date:   Thu Aug 19 17:54:43 2021 +0530

    Substrate changes for sending account_uuid for ahv_substrates (#56) (#61)

    * Substrate changes, so that correct account_uuid is supplied while creating/compiling blueprint with ahv provider

    * Fixing logic to not use nic.compile() at substrate compile as it involves parent reference

    * Fixing tcs as per latest changes

    * Minor fix when cluster name is not same as cluster account name.

    * Fixing snapshot restore compile test

commit cc3fdb4
Author: Abhijeet Singh Kaurav <[email protected]>
Date:   Thu Aug 19 09:50:20 2021 +0530

    Task/m calm 27024 runbook containing durga macros (#58) (#59)

    * Add runbbok containing all macros and test for it

    * minor fix

    * make black

    * Adding todo  task

commit 24c616a
Author: Mayank Choudhary <[email protected]>
Date:   Tue Aug 17 13:47:23 2021 +0530

    Topic/m multivm snapshot changes calm 18417 (#57)

    Summary of changes - https://docs.google.com/document/d/1Ams2OqjtOf74LYf5IwTAnAsyCpcrft6ydPGi0DrZztE/edit?pli=1#heading=h.8n3rtdfbxnjx

     Conflicts:
    	calm/dsl/api/handle.py
    	calm/dsl/builtins/__init__.py
    	calm/dsl/cli/__init__.py
    	calm/dsl/db/table_config.py

(cherry picked from commit 06859889c686f02d0c302ef5e6bf56e1191b9fc3)
…er (#93)

* fixed scheduler patching

* fixed variables patching

* black related formatting fixes

(cherry picked from commit 737e1d3e640893959f399d85c86cca5c769f730e)
* Add base structure of helper class to collect provider related resource info

* Reverting Add base structure of helper class to collect provider related resource info

* Add base structure of helper class to collect provider related resource info

* Redesign populator class for cli provider plugins tests

* 1. Add implementation of aws resource info populator for aws cli provider_spec tests
2. Make Constants file for cli provider_spec tests and add aws related constants to it.

* Update provder_spec test aws related constants

* 1. Add implementation in populators for getting subnets info of aws provider.
2. Update VPCs resource info logic
3. Update spec files of aws provider_spec create tests with setup related dependencies info for resolving in runtime.

* 1. Add input dependencies resolver logic for cli provider_plugins tests
2. Update aws cli tests spec yamls with default indexes

* 1. Add azure base method for populating resource info.
2. Update dependencies resolver methods to fails for missing resource info.
3. Fixed comments in aws provider test spec file

* Formatting

* Change yaml spec

* Update aws provider plugins test spec and constansts

* Formatting(black)

(cherry picked from commit 704358cbfac613732f5ea3ea75a389bd74385b93)
This reverts commit 704358cbfac613732f5ea3ea75a389bd74385b93.

(cherry picked from commit abd84acc359dd5dc262544a7f376f4535900e046)
It is observed intermittently, that application delete
fails with below error
```
{
    "error": {
        "api_version": "3.1",
        "code": 422,
        "kind": "app",
        "message_list": [
            {
                "details": {},
                "message": "Unable to run normal delete action on Application.",
                "reason": "INVALID_REQUEST"
            }
        ],
        "state": "ERROR"
    },
    "code": 422
}
```
to make sure if the issue persists let's introduce a minimal
wait before delete action and confirm if it can be recreated in realtime.

Signed-off-by: Satheesh Rajendran <[email protected]>
(cherry picked from commit a601e715fbd1ae0c2d3c0779bb0f0f730c9ada89)
* Add base structure of helper class to collect provider related resource info

* Reverting Add base structure of helper class to collect provider related resource info

* Add base structure of helper class to collect provider related resource info

* Redesign populator class for cli provider plugins tests

* 1. Add implementation of aws resource info populator for aws cli provider_spec tests
2. Make Constants file for cli provider_spec tests and add aws related constants to it.

* Update provder_spec test aws related constants

* 1. Add implementation in populators for getting subnets info of aws provider.
2. Update VPCs resource info logic
3. Update spec files of aws provider_spec create tests with setup related dependencies info for resolving in runtime.

* 1. Add input dependencies resolver logic for cli provider_plugins tests
2. Update aws cli tests spec yamls with default indexes

* 1. Add azure base method for populating resource info.
2. Update dependencies resolver methods to fails for missing resource info.
3. Fixed comments in aws provider test spec file

* Formatting

* Change yaml spec

* Update aws provider plugins test spec and constansts

* Formatting(black)

* Fix populators for vmware

* Add __init__.py to cli in tests to make it available for imports

* Fix populators.py imports

* Unskip cli provider spec aws tests

(cherry picked from commit a5172ee5f345da41483333ee99cd8a61dc7b387d)
…ject of which they are part of is not set in the DSL config (#96)

* Don't let user create job in scheduler with app or runbook if the project of which they are part of is not set in the DSL config

* black formatting changes

* changed logic

* black code refactor

* dont use metadata_payload. Added delete job in test

* remove metadata changes

* black formatting changes

* fixed delete call

* fixed delete call

(cherry picked from commit cfadb510156923e511b04595bd2ce13cde8a9659)
* reduced length of job name

* changes for limiting job name to 64 chars in tests

(cherry picked from commit 929785872df772d17189e89a4cef200570e3e80c)
* Add base structure of helper class to collect provider related resource info

* Reverting Add base structure of helper class to collect provider related resource info

* Add base structure of helper class to collect provider related resource info

* Redesign populator class for cli provider plugins tests

* 1. Add implementation of aws resource info populator for aws cli provider_spec tests
2. Make Constants file for cli provider_spec tests and add aws related constants to it.

* Update provder_spec test aws related constants

* 1. Add implementation in populators for getting subnets info of aws provider.
2. Update VPCs resource info logic
3. Update spec files of aws provider_spec create tests with setup related dependencies info for resolving in runtime.

* 1. Add input dependencies resolver logic for cli provider_plugins tests
2. Update aws cli tests spec yamls with default indexes

* 1. Add azure base method for populating resource info.
2. Update dependencies resolver methods to fails for missing resource info.
3. Fixed comments in aws provider test spec file

* Formatting

* Change yaml spec

* fixing provider_spec test cases for Azure

* unskippping azure cli tests and resolving merge conflicts

* reformatting the code

* reformatting code

Co-authored-by: Pradeepsingh Bhati <[email protected]>
(cherry picked from commit 4ad2f2c346d25ac55bca84b050e689db22dbe20c)
* Fix test_while_task_order test for Calm-22720 changes

* Minor fix

(cherry picked from commit 2945346e84c436b8dcdb02339c3f7aefeb50af18)
* Add logic to use version based rubook runner api

* Formating

(cherry picked from commit 425943d297e32c578a21915bb2eb90e88a3fe8ab)
commit 351b5c0
Author: abhijeetkaurav1st <[email protected]>
Date:   Thu Dec 16 14:14:30 2021 +0530

    Minor fixes for undefined attributes at profile model for version setup < 3.3.0.

commit 7ea5982
Author: Abhijeet Singh Kaurav <[email protected]>
Date:   Wed Dec 15 19:03:06 2021 +0530

    Added support for get_runbook_action and macro in ahv-disk-images (#206)

    * Allow macro in image names

    * Adding example that shows macor usage in vm-disk-image and vm-nic

    * Adding helper get_runbook_action for getting action out of imported runbook

    * Adding exsiting machine example and minor improvements

    * minor fixes in models

    * Fixing runbook examples

commit bc9dc6a
Author: Abhijeet Singh Kaurav <[email protected]>
Date:   Mon Dec 13 20:25:01 2021 +0530

    Use ASCENDING order for list_all query (#205)

    fixes #200

commit 909aba1
Author: Abhijeet Singh Kaurav <[email protected]>
Date:   Tue Nov 23 21:46:40 2021 +0530

    Fix for issue 187 (#202)

    * Fixing project update and adding account addition through cli switches

    * Adding test for accoun updation through cli switches

    * Fixing project update using dsl file and adding test for it

    * Added changes in readme

commit a4b8957
Author: Abhijeet Singh Kaurav <[email protected]>
Date:   Wed Nov 17 21:37:28 2021 +0530

    Add uuid in env-creation payload (#201)

    * Add uuid in env-creation payload

    * black format

commit 7dbb87d
Author: Abhijeet Singh Kaurav <[email protected]>
Date:   Thu Nov 11 14:32:50 2021 +0530

    Fixing the min_version on cache tables (#199)

commit 6586409
Author: abhijeetkaurav1st <[email protected]>
Date:   Tue Nov 9 12:17:02 2021 +0530

    Fixing readme/examples for disk-delete in app-edit

commit 547dea1
Author: abhijeetkaurav1st <[email protected]>
Date:   Tue Nov 9 10:09:15 2021 +0530

    Fixing links in release-notes

commit e5d97b4
Merge: a704367 36dfaf1
Author: Abhijeet Singh Kaurav <[email protected]>
Date:   Mon Nov 8 19:29:36 2021 +0530

    Merge pull request #198 from nutanix/release/3.3.0

    Changes for Calm v3.3.0

commit 36dfaf1
Merge: a704367 95bb44e
Author: abhijeetkaurav1st <[email protected]>
Date:   Mon Nov 8 14:15:09 2021 +0530

    Merge branch 'release/3.3.0' of github.com:ideadevice/calm-dsl into release/3.3.0

commit 95bb44e
Author: abhijeetkaurav1st <[email protected]>
Date:   Mon Nov 8 09:50:18 2021 +0530

    Fixing some brownfield and env fixes

commit 4797f32
Author: abhijeetkaurav1st <[email protected]>
Date:   Wed Nov 3 22:46:10 2021 +0530

    Black format

commit 3de448f
Author: abhijeetkaurav1st <[email protected]>
Date:   Wed Nov 3 22:35:31 2021 +0530

    Minor fixes regarding release-notes and some command name fixes

commit 370c975
Author: gaurav <[email protected]>
Date:   Tue Nov 2 23:35:22 2021 +0530

    App edit DSL support (#43) (#92)

    * initial commit for app edit -> parts taken from ideadevice/calm-dsl#19

    * lint fix

    * lint fix

    * lint fix

    * fixes

    * import fix

    * remove extra file

    * fix app edit dsl

    * add example

    * test

    * bring in some structure

    * del

    * remove extra

    * fixed example

    * revert extra changes

    * fixes

    * lint

    * minor change

    * cleanup 1

    * cleanup 2

    * cleanup 3

    * lint

    * make patch run work

    * lint

    * list patches in app describe

    * review comments and fixes

    * fix

    * add patch handler

    * change to update config

    * some more fixes

    * some more fixes

    * make update like sys action

    * fixed nic example

    * fix disk add

    * added helper class

    * initial class structure

    * make nic del work

    * add for category and fixed some bugs

    * add min level

    * add min version in profile also

    * Add skip/modify/delete prompt

    * extract prompt function

    * Interactively modify patch payload for app edit

    * extract prompt functions

    * set min/max based on operation

    * exclude nics and disks in use while deleting

    * comment out (unnecessary?) parts

    * format changes

    * remove unnecessary comments

    * remove patch_editables parameter

    * change name for UpdateConfigAttrs to AhvUpdateConfigAttrs

    * fix

    * fix

    * fix

    * change compile to get_user_attrs

    * change validator

    * ipdb

    * fix

    * disk and nic

    * changes

    * fix

    * fix

    * parse patch editables from file input non-interactively

    * handle file editables for multiple attrs

    * fix delete operations

    * add disk and category addition logic

    * fix nic delete operation

    * Add logs for editables parsed through file

    * Fix mistakes in comments and logs

    * Add updating status to app describe command

    * Use global update command instead of overriding

    * Add ignore_runtime_variables flag

    * Add test for ahv patch editables

    * Change nic source from config file

    * Use nic name instead of cluster and nic name

    * move wait for states func to helper class

    * Add section headings while interactively editing variables

    * remove nic delete from bp in test

    * Add more information about editables during interaction

    * fix tests

    * Formatting changes

    * fix snapshot restore test

    * Run formatter

    * move logic to compile

    * add default values

    * fix

    * fix empty patch attrs

    * fix

    * fix

    * remove unwanted file

    * adding test cases for app edit feat

    * adding disk operations to the patach

    * adding validations to the test cases

    * Minor fix in tests

    * adding disk delete and disk modify operations to the patch

    * changeng nic value

    * add release notes

    * add release notes

    * removing breakpoints

    * add release notes

    Co-authored-by: Shreevari SP <[email protected]>
    Co-authored-by: Shreevari SP <[email protected]>
    Co-authored-by: anilkumarkondeti <[email protected]>
    Co-authored-by: abhijeetkaurav1st <[email protected]>
    Co-authored-by: anilkumarkondeti <[email protected]>

    Co-authored-by: Shreevari SP <[email protected]>
    Co-authored-by: Shreevari SP <[email protected]>
    Co-authored-by: anilkumarkondeti <[email protected]>
    Co-authored-by: abhijeetkaurav1st <[email protected]>
    Co-authored-by: anilkumarkondeti <[email protected]>

commit ba9b246
Author: Mayank Choudhary <[email protected]>
Date:   Tue Nov 2 23:17:59 2021 +0530

    snapshot-restore release notes for 3.3.0 (#75) (#91)

    * snapshot-restore release notes

    * add link to bp example

commit 469fd80
Author: Pradeepsingh Bhati <[email protected]>
Date:   Fri Oct 22 18:36:01 2021 +0530

    Add interface and implementations for aws provider specific api object for different calm versions. (#78) (#88)

    * 1. Add interface for aws provider specific api
    2. Add/restructure implementation of aws api object for different calm versions

    * Reformatting files

    * Reformat import statements

    * Reformatting files(black)

    * Fix version number for aws provider spec object

commit a704367
Author: abhijeetkaurav1st <[email protected]>
Date:   Thu Oct 21 09:18:34 2021 +0530

commit b4162cd
Merge: f68e3eb 905fce3
Author: Abhijeet Singh Kaurav <[email protected]>
Date:   Sun Oct 17 20:43:35 2021 +0530

    Merge pull request #85 from ideadevice/task/3.3.0-cherrypick-calm-20742-changes

    Task/3.3.0 cherrypick calm 20742 changes

commit 905fce3
Author: Abhijeet Singh Kaurav <[email protected]>
Date:   Sun Oct 17 12:59:12 2021 +0530

    Task/m calm 20742 vm recovery point changes (#76)

    * recovery point changes for bps

    * Adding api changes

    * Adding get commands

    * Adding final validations and substrate fixes for vm_recovery_spec

    * Adding tests for recovery point bp launches

    * Minor fix

    * Minor fix in substrate

    * Fix serial_port_list for ahv_vm.py

    * Adding minor log

    * Added catch to check exception

    * Minor fix

    * Test fix

    * Test fix

    * Fixing network name in test blueprint

commit 4d4da6b
Author: abhijeetkaurav1st <[email protected]>
Date:   Wed Sep 15 16:15:46 2021 +0530

    Skipping runbook test due to CALM-27162

commit fef58ac
Author: Abhijeet Singh Kaurav <[email protected]>
Date:   Mon Sep 13 12:08:30 2021 +0530

    Using common helper for waiting for non-busy state (#71)

    * Using common helper for waiting for non-busy state

    * Minor fix

commit b90e676
Author: abhijeetkaurav1st <[email protected]>
Date:   Thu Sep 30 15:20:27 2021 +0530

    Fixing groups helper for caps name and update project using cli switch

commit f68e3eb
Author: anilkumarkondeti <[email protected]>
Date:   Thu Sep 9 18:10:54 2021 +0530

    ignoring VPC subnets (#70) (#74)

commit a6ce146
Author: Pradeepsingh Bhati <[email protected]>
Date:   Thu Sep 9 17:59:22 2021 +0530

    Fix template_id issue when there is no template for vmware create spec (#72) (#73)

    * Fix template_id issue when there is no template for vmware create spec

    * Reformatting

commit 979aa37
Author: Mayank Choudhary <[email protected]>
Date:   Wed Sep 1 16:13:01 2021 +0530

    fix expiry type in cache (#66) (#67)

commit 5c9395e
Author: Mayank Choudhary <[email protected]>
Date:   Wed Sep 1 13:29:20 2021 +0530

    safety checks for protection rule expiry (#64) (#65)

    * safety checks for protection rule expiry

    * safety checks for protection rule expiry while updating cache

commit 8ad8e08
Author: Mayank Choudhary <[email protected]>
Date:   Mon Aug 23 16:59:02 2021 +0530

    protection policy fixes (#60) (#62)

    - #CALM-27047, #CALM-27044 and #CALM-27046

commit 95f3390
Author: Abhijeet Singh Kaurav <[email protected]>
Date:   Thu Aug 19 17:54:43 2021 +0530

    Substrate changes for sending account_uuid for ahv_substrates (#56) (#61)

    * Substrate changes, so that correct account_uuid is supplied while creating/compiling blueprint with ahv provider

    * Fixing logic to not use nic.compile() at substrate compile as it involves parent reference

    * Fixing tcs as per latest changes

    * Minor fix when cluster name is not same as cluster account name.

    * Fixing snapshot restore compile test

commit cc3fdb4
Author: Abhijeet Singh Kaurav <[email protected]>
Date:   Thu Aug 19 09:50:20 2021 +0530

    Task/m calm 27024 runbook containing durga macros (#58) (#59)

    * Add runbbok containing all macros and test for it

    * minor fix

    * make black

    * Adding todo  task

commit 24c616a
Author: Mayank Choudhary <[email protected]>
Date:   Tue Aug 17 13:47:23 2021 +0530

    Topic/m multivm snapshot changes calm 18417 (#57)

    Summary of changes - https://docs.google.com/document/d/1Ams2OqjtOf74LYf5IwTAnAsyCpcrft6ydPGi0DrZztE/edit?pli=1#heading=h.8n3rtdfbxnjx

     Conflicts:
    	calm/dsl/api/handle.py
    	calm/dsl/builtins/__init__.py
    	calm/dsl/cli/__init__.py
    	calm/dsl/db/table_config.py

(cherry picked from commit ca9f715d6e89ce981cf4d7950efc7c89d69d9abf)
(cherry picked from commit f47759be06872672578cb7a61e595e902fe67574)
(cherry picked from commit 8d050d0f6b9e1580d4ef1911fd3bebf1eb774ab1)
* Update runbook test to add default project reference

* Formatting

* Skip runbook tests

(cherry picked from commit 1443df8b4aaa1308a80a3d7e8ac036f4256dcea9)
bhati-pradeep and others added 27 commits March 13, 2022 12:56
(cherry picked from commit a4d6bb957771cb9e9466445f1a8a21ad20f939f6)
(cherry picked from commit 06f0a4ceca43564d67f4b84360adf33db4117e5b)
(cherry picked from commit 4278a4cc51bd06699a0b86d8fb61c3aabfeabc63)
(cherry picked from commit 00a33bce22c12b47376d2352cd9ee110bae1a27d)
(cherry picked from commit 497d68596ad5ef1e5715e8f5e72395d24386c975)
(cherry picked from commit b914041469850725ba6ab1bd4c327cf355b01263)
(cherry picked from commit f37ef583c17441cbc777ba2d0c642a880e5df273)
* Add implementation to delete vms post dsl test run

* Update api call for vm delete

* Use /vms api for vm delete

* remove unwanted import statement

* Formatting

* Add file exists check. Fix typo in logs

* Fix minor typo

* Change logs from info to delete

* Minor typ fix

* Formatting

(cherry picked from commit 4a5025538d9b1150b525fcfb39d27b9659d5b139)
tests/cli/runtime_helpers/ahv/test_app_edit_json.py:test_json
this test fetchs subnet uuid from hard coded positional value of config which seems
populated in runtime and does not always guarantee , leads to test fail,
let's make sure always select the right subnet's uuid.

Fixes: https://jira.nutanix.com/browse/CALM-29867

Signed-off-by: Satheesh Rajendran <[email protected]>
(cherry picked from commit afa15ef02f443b2d88114d82147653499c5005cd)
Fixes below issues:
1. filter length used for job list is not adequate during parallel run on regression due which test fails.
2. wrong keyword used for onetime test file check.
3. app name is not suffixed with random values which is failing on a rerun incase of failure/manual run during triage.

Fixes: https://jira.nutanix.com/browse/CALM-29866

Signed-off-by: Satheesh Rajendran <[email protected]>
(cherry picked from commit c68c04854c6a80ffe088a0ea6f67963d4a674652)
* fixed project reference issue in dsl

* formatting fix

* CALM-29774-If no project is define in metadata it will take the project from config file

(cherry picked from commit d8d60881823fd69ca0c39da2638db05ad6945de3)
#113)" (#121)

This reverts commit 4a5025538d9b1150b525fcfb39d27b9659d5b139.

(cherry picked from commit 00b31f6eaeee2374185d5ab6f17d6e164fff0894)
…#Issue-208 (#120)

* Added support to allow bp launch environment patching with secrets

* Corrected docstring

* Updated the param and logs

(cherry picked from commit 362d6f06b7c47541731436db4899ef189e0be420)
* Add default project dependency in spec yaml as well

* Add default project dependency in azure spec yaml

* Fix provider spec azure populators

* Formatting

(cherry picked from commit 6238fdce8902bbca0768fe2c5733607626ddba28)
Sync private repo with public repo changes

(cherry picked from commit b14009d15ec81690b2f306ea8e3b727c9b9548d0)
* Handle runtime runbook,app name changes to DSL file

Handle runtime runbook,app name changes to DSL file

Fixes: c68c04854c6a80ffe088a0ea6f67963d4a674652

* Fix format issue reported by black

Fix format issue reported by black

(cherry picked from commit ae81e0bd73515af9820dcb75a1e2da16a0e37736)
* Topic/m multivm snapshot changes calm 18417 (#57)

Summary of changes - https://docs.google.com/document/d/1Ams2OqjtOf74LYf5IwTAnAsyCpcrft6ydPGi0DrZztE/edit?pli=1#heading=h.8n3rtdfbxnjx

 Conflicts:
	calm/dsl/api/handle.py
	calm/dsl/builtins/__init__.py
	calm/dsl/cli/__init__.py
	calm/dsl/db/table_config.py

* Task/m calm 27024 runbook containing durga macros (#58) (#59)

* Add runbbok containing all macros and test for it

* minor fix

* make black

* Adding todo  task

* Substrate changes for sending account_uuid for ahv_substrates (#56) (#61)

* Substrate changes, so that correct account_uuid is supplied while creating/compiling blueprint with ahv provider

* Fixing logic to not use nic.compile() at substrate compile as it involves parent reference

* Fixing tcs as per latest changes

* Minor fix when cluster name is not same as cluster account name.

* Fixing snapshot restore compile test

* protection policy fixes (#60) (#62)

- #CALM-27047, #CALM-27044 and #CALM-27046

* safety checks for protection rule expiry (#64) (#65)

* safety checks for protection rule expiry

* safety checks for protection rule expiry while updating cache

* fix expiry type in cache (#66) (#67)

* Fix template_id issue when there is no template for vmware create spec (#72) (#73)

* Fix template_id issue when there is no template for vmware create spec

* Reformatting

* ignoring VPC subnets (#70) (#74)

* Fixing groups helper for caps name and update project using cli switch

* Using common helper for waiting for non-busy state (#71)

* Using common helper for waiting for non-busy state

* Minor fix

* Skipping runbook test due to CALM-27162

* Task/m calm 20742 vm recovery point changes (#76)

* recovery point changes for bps

* Adding api changes

* Adding get commands

* Adding final validations and substrate fixes for vm_recovery_spec

* Adding tests for recovery point bp launches

* Minor fix

* Minor fix in substrate

* Fix serial_port_list for ahv_vm.py

* Adding minor log

* Added catch to check exception

* Minor fix

* Test fix

* Test fix

* Fixing network name in test blueprint

* #CALM-28014 Fixing environment ref to pick correct environment

* Add interface and implementations for aws provider specific api object for different calm versions. (#78) (#88)

* 1. Add interface for aws provider specific api
2. Add/restructure implementation of aws api object for different calm versions

* Reformatting files

* Reformat import statements

* Reformatting files(black)

* Fix version number for aws provider spec object

* snapshot-restore release notes for 3.3.0 (#75) (#91)

* snapshot-restore release notes

* add link to bp example

* App edit DSL support (#43) (#92)

* initial commit for app edit -> parts taken from ideadevice/calm-dsl#19

* lint fix

* lint fix

* lint fix

* fixes

* import fix

* remove extra file

* fix app edit dsl

* add example

* test

* bring in some structure

* del

* remove extra

* fixed example

* revert extra changes

* fixes

* lint

* minor change

* cleanup 1

* cleanup 2

* cleanup 3

* lint

* make patch run work

* lint

* list patches in app describe

* review comments and fixes

* fix

* add patch handler

* change to update config

* some more fixes

* some more fixes

* make update like sys action

* fixed nic example

* fix disk add

* added helper class

* initial class structure

* make nic del work

* add for category and fixed some bugs

* add min level

* add min version in profile also

* Add skip/modify/delete prompt

* extract prompt function

* Interactively modify patch payload for app edit

* extract prompt functions

* set min/max based on operation

* exclude nics and disks in use while deleting

* comment out (unnecessary?) parts

* format changes

* remove unnecessary comments

* remove patch_editables parameter

* change name for UpdateConfigAttrs to AhvUpdateConfigAttrs

* fix

* fix

* fix

* change compile to get_user_attrs

* change validator

* ipdb

* fix

* disk and nic

* changes

* fix

* fix

* parse patch editables from file input non-interactively

* handle file editables for multiple attrs

* fix delete operations

* add disk and category addition logic

* fix nic delete operation

* Add logs for editables parsed through file

* Fix mistakes in comments and logs

* Add updating status to app describe command

* Use global update command instead of overriding

* Add ignore_runtime_variables flag

* Add test for ahv patch editables

* Change nic source from config file

* Use nic name instead of cluster and nic name

* move wait for states func to helper class

* Add section headings while interactively editing variables

* remove nic delete from bp in test

* Add more information about editables during interaction

* fix tests

* Formatting changes

* fix snapshot restore test

* Run formatter

* move logic to compile

* add default values

* fix

* fix empty patch attrs

* fix

* fix

* remove unwanted file

* adding test cases for app edit feat

* adding disk operations to the patach

* adding validations to the test cases

* Minor fix in tests

* adding disk delete and disk modify operations to the patch

* changeng nic value

* add release notes

* add release notes

* removing breakpoints

* add release notes

Co-authored-by: Shreevari SP <[email protected]>
Co-authored-by: Shreevari SP <[email protected]>
Co-authored-by: anilkumarkondeti <[email protected]>
Co-authored-by: abhijeetkaurav1st <[email protected]>
Co-authored-by: anilkumarkondeti <[email protected]>

Co-authored-by: Shreevari SP <[email protected]>
Co-authored-by: Shreevari SP <[email protected]>
Co-authored-by: anilkumarkondeti <[email protected]>
Co-authored-by: abhijeetkaurav1st <[email protected]>
Co-authored-by: anilkumarkondeti <[email protected]>

* Minor fixes regarding release-notes and some command name fixes

* Black format

* Fixing some brownfield and env fixes

* Fixing links in release-notes

* Fixing readme/examples for disk-delete in app-edit

* Fixing the min_version on cache tables (#199)

* Add uuid in env-creation payload (#201)

* Add uuid in env-creation payload

* black format

* Fix for issue 187 (#202)

* Fixing project update and adding account addition through cli switches

* Adding test for accoun updation through cli switches

* Fixing project update using dsl file and adding test for it

* Added changes in readme

* Use ASCENDING order for list_all query (#205)

fixes #200

* Added support for get_runbook_action and macro in ahv-disk-images (#206)

* Allow macro in image names

* Adding example that shows macor usage in vm-disk-image and vm-nic

* Adding helper get_runbook_action for getting action out of imported runbook

* Adding exsiting machine example and minor improvements

* minor fixes in models

* Fixing runbook examples

* Minor fixes for undefined attributes at profile model for version setup < 3.3.0.

* Test for class

* Sorry! Reverting demo change.

* Allowing `-ws` flags for bp launch (#209)

* Allowing `-ws` flags for bp launch

* Minor fix for env list call for fetching policies

* Fixing black version for github action (#210)

* Sample fix

* Sample fix

* More minor fixes

* fix ipython version to 7.16.3 due to ipython vulnerability
GHSA-pq7m-3gw7-gq5x

* Fix AHV subnet queries for >30 entities #CALM-29779 (#211)

* Fix AHV subnet queries for >30 entities #CALM-29779

Resolves #207

* Fixed lint

* Fixed subnet queries in another couple of places

* use jinja2 3.0.3 library (#215)

* Oncall/m oncall 12576 calm cache issue (#214)

* added no cache flag

* env create restricted with no cache update

* black format the files

* minor fix for subnet query

* fixing test

* update the readme for experimental behaviour.

Co-authored-by: abhijeetkaurav1st <[email protected]>

Co-authored-by: Mayank Choudhary <[email protected]>
Co-authored-by: Pradeepsingh Bhati <[email protected]>
Co-authored-by: anilkumarkondeti <[email protected]>
Co-authored-by: Mayank Choudhary <[email protected]>
Co-authored-by: gaurav <[email protected]>
Co-authored-by: Shreevari SP <[email protected]>
Co-authored-by: Shreevari SP <[email protected]>
Co-authored-by: anilkumarkondeti <[email protected]>
Co-authored-by: Mark <[email protected]>
Co-authored-by: Kiran Shenoy <[email protected]>
Co-authored-by: Utkarsh Bairolia <[email protected]>
(cherry picked from commit 69680c17170d2ae9b89c483d1be3634101b60f9c)
* Topic/m multivm snapshot changes calm 18417 (#57)

Summary of changes - https://docs.google.com/document/d/1Ams2OqjtOf74LYf5IwTAnAsyCpcrft6ydPGi0DrZztE/edit?pli=1#heading=h.8n3rtdfbxnjx

 Conflicts:
	calm/dsl/api/handle.py
	calm/dsl/builtins/__init__.py
	calm/dsl/cli/__init__.py
	calm/dsl/db/table_config.py

* Task/m calm 27024 runbook containing durga macros (#58) (#59)

* Add runbbok containing all macros and test for it

* minor fix

* make black

* Adding todo  task

* Substrate changes for sending account_uuid for ahv_substrates (#56) (#61)

* Substrate changes, so that correct account_uuid is supplied while creating/compiling blueprint with ahv provider

* Fixing logic to not use nic.compile() at substrate compile as it involves parent reference

* Fixing tcs as per latest changes

* Minor fix when cluster name is not same as cluster account name.

* Fixing snapshot restore compile test

* protection policy fixes (#60) (#62)

- #CALM-27047, #CALM-27044 and #CALM-27046

* safety checks for protection rule expiry (#64) (#65)

* safety checks for protection rule expiry

* safety checks for protection rule expiry while updating cache

* fix expiry type in cache (#66) (#67)

* Fix template_id issue when there is no template for vmware create spec (#72) (#73)

* Fix template_id issue when there is no template for vmware create spec

* Reformatting

* ignoring VPC subnets (#70) (#74)

* Fixing groups helper for caps name and update project using cli switch

* Using common helper for waiting for non-busy state (#71)

* Using common helper for waiting for non-busy state

* Minor fix

* Skipping runbook test due to CALM-27162

* Task/m calm 20742 vm recovery point changes (#76)

* recovery point changes for bps

* Adding api changes

* Adding get commands

* Adding final validations and substrate fixes for vm_recovery_spec

* Adding tests for recovery point bp launches

* Minor fix

* Minor fix in substrate

* Fix serial_port_list for ahv_vm.py

* Adding minor log

* Added catch to check exception

* Minor fix

* Test fix

* Test fix

* Fixing network name in test blueprint

* #CALM-28014 Fixing environment ref to pick correct environment

* Add interface and implementations for aws provider specific api object for different calm versions. (#78) (#88)

* 1. Add interface for aws provider specific api
2. Add/restructure implementation of aws api object for different calm versions

* Reformatting files

* Reformat import statements

* Reformatting files(black)

* Fix version number for aws provider spec object

* snapshot-restore release notes for 3.3.0 (#75) (#91)

* snapshot-restore release notes

* add link to bp example

* App edit DSL support (#43) (#92)

* initial commit for app edit -> parts taken from ideadevice/calm-dsl#19

* lint fix

* lint fix

* lint fix

* fixes

* import fix

* remove extra file

* fix app edit dsl

* add example

* test

* bring in some structure

* del

* remove extra

* fixed example

* revert extra changes

* fixes

* lint

* minor change

* cleanup 1

* cleanup 2

* cleanup 3

* lint

* make patch run work

* lint

* list patches in app describe

* review comments and fixes

* fix

* add patch handler

* change to update config

* some more fixes

* some more fixes

* make update like sys action

* fixed nic example

* fix disk add

* added helper class

* initial class structure

* make nic del work

* add for category and fixed some bugs

* add min level

* add min version in profile also

* Add skip/modify/delete prompt

* extract prompt function

* Interactively modify patch payload for app edit

* extract prompt functions

* set min/max based on operation

* exclude nics and disks in use while deleting

* comment out (unnecessary?) parts

* format changes

* remove unnecessary comments

* remove patch_editables parameter

* change name for UpdateConfigAttrs to AhvUpdateConfigAttrs

* fix

* fix

* fix

* change compile to get_user_attrs

* change validator

* ipdb

* fix

* disk and nic

* changes

* fix

* fix

* parse patch editables from file input non-interactively

* handle file editables for multiple attrs

* fix delete operations

* add disk and category addition logic

* fix nic delete operation

* Add logs for editables parsed through file

* Fix mistakes in comments and logs

* Add updating status to app describe command

* Use global update command instead of overriding

* Add ignore_runtime_variables flag

* Add test for ahv patch editables

* Change nic source from config file

* Use nic name instead of cluster and nic name

* move wait for states func to helper class

* Add section headings while interactively editing variables

* remove nic delete from bp in test

* Add more information about editables during interaction

* fix tests

* Formatting changes

* fix snapshot restore test

* Run formatter

* move logic to compile

* add default values

* fix

* fix empty patch attrs

* fix

* fix

* remove unwanted file

* adding test cases for app edit feat

* adding disk operations to the patach

* adding validations to the test cases

* Minor fix in tests

* adding disk delete and disk modify operations to the patch

* changeng nic value

* add release notes

* add release notes

* removing breakpoints

* add release notes

Co-authored-by: Shreevari SP <[email protected]>
Co-authored-by: Shreevari SP <[email protected]>
Co-authored-by: anilkumarkondeti <[email protected]>
Co-authored-by: abhijeetkaurav1st <[email protected]>
Co-authored-by: anilkumarkondeti <[email protected]>

Co-authored-by: Shreevari SP <[email protected]>
Co-authored-by: Shreevari SP <[email protected]>
Co-authored-by: anilkumarkondeti <[email protected]>
Co-authored-by: abhijeetkaurav1st <[email protected]>
Co-authored-by: anilkumarkondeti <[email protected]>

* Minor fixes regarding release-notes and some command name fixes

* Black format

* Fixing some brownfield and env fixes

* Fixing links in release-notes

* Fixing readme/examples for disk-delete in app-edit

* Fixing the min_version on cache tables (#199)

* Add uuid in env-creation payload (#201)

* Add uuid in env-creation payload

* black format

* Fix for issue 187 (#202)

* Fixing project update and adding account addition through cli switches

* Adding test for accoun updation through cli switches

* Fixing project update using dsl file and adding test for it

* Added changes in readme

* Use ASCENDING order for list_all query (#205)

fixes #200

* Added support for get_runbook_action and macro in ahv-disk-images (#206)

* Allow macro in image names

* Adding example that shows macor usage in vm-disk-image and vm-nic

* Adding helper get_runbook_action for getting action out of imported runbook

* Adding exsiting machine example and minor improvements

* minor fixes in models

* Fixing runbook examples

* Minor fixes for undefined attributes at profile model for version setup < 3.3.0.

* Test for class

* Sorry! Reverting demo change.

* Allowing `-ws` flags for bp launch (#209)

* Allowing `-ws` flags for bp launch

* Minor fix for env list call for fetching policies

* Fixing black version for github action (#210)

* Sample fix

* Sample fix

* More minor fixes

* fix ipython version to 7.16.3 due to ipython vulnerability
GHSA-pq7m-3gw7-gq5x

* Fix AHV subnet queries for >30 entities #CALM-29779 (#211)

* Fix AHV subnet queries for >30 entities #CALM-29779

Resolves #207

* Fixed lint

* Fixed subnet queries in another couple of places

* use jinja2 3.0.3 library (#215)

* Oncall/m oncall 12576 calm cache issue (#214)

* added no cache flag

* env create restricted with no cache update

* black format the files

* minor fix for subnet query

* fixing test

* update the readme for experimental behaviour.

Co-authored-by: abhijeetkaurav1st <[email protected]>

* Minor fix for merge conflict in bp_commands

Co-authored-by: Mayank Choudhary <[email protected]>
Co-authored-by: Pradeepsingh Bhati <[email protected]>
Co-authored-by: anilkumarkondeti <[email protected]>
Co-authored-by: Mayank Choudhary <[email protected]>
Co-authored-by: gaurav <[email protected]>
Co-authored-by: Shreevari SP <[email protected]>
Co-authored-by: Shreevari SP <[email protected]>
Co-authored-by: anilkumarkondeti <[email protected]>
Co-authored-by: Mark <[email protected]>
Co-authored-by: Kiran Shenoy <[email protected]>
Co-authored-by: Utkarsh Bairolia <[email protected]>
(cherry picked from commit 7b1762c0fc103904c2e434b7585d090281418eca)
* Initial changes for dynamic creds DSL

* Added library changes required for dynamic creds

* Minor fixes

* Fixed execution errors

* Minor fixes

* Revered changes

* Added TCs

* Fixed Cred Libs

* Addressed comments

* Removed marker

* Addressed comments

* black format

* Fixing x-calm-dsl-min-versio and x-calm-dsl-default-required for dsl_entity type =  object

* Use default required as false for cred-variables

* Use x-calm-dsl-default-required fort passphrase in credential

* Fixing json comparism tests

* Fix runbook dyn cred tests

* Added constants to use creds in TCs

* Fixed JSON comparison tests

Co-authored-by: abhijeetkaurav1st <[email protected]>
(cherry picked from commit 82fba66869c4d9a776127cb53b877860d775ff45)
* Add implementation to use projects_internal api for getting acp info instead of acp list api

* Add logic for limit and offset in get_acps_from_project method

* Add Minor comments and changes

* Remove not required imports

* formatting

(cherry picked from commit 07b89d1baca31339560569b37cf5ead0db198ce1)
Sync public branch changes

(cherry picked from commit d7eb3ef2a3e8defc9690ec20ff30b3e7a8bd7e23)
* change in dependencies

* fixing formatting

* re-foramtted files

* intall backports

(cherry picked from commit 49a84dfa40d0820212bd83c2992a4a90521dc4fe)
* Move JobScheduler interface to builtins

* Fixing examples for the job

(cherry picked from commit 7f879048442cd97697ee22b8e858d325578d6606)
* Adding basic changes for 3.4 release-notes

* Task/m 3.4.0 release notes dyn cred (#138)

* Added a readme for dyn creds

* Added readme

* Addressed comments

* Fixed text alignment

* Fixed text alignments

* Added scheduler commands to readme

* fixed typo in readme for scheduler command

* Update README.md

* Update README.md

* Update README.md

* Update README.md

* Modifed realease notes

* Updated more readme changes

Co-authored-by: ManjunathReg <[email protected]>
Co-authored-by: tayalakansh <[email protected]>
(cherry picked from commit 6401de09e36423d3c1820bae339004e970e9f2d2)
@abhijeetkaurav1st abhijeetkaurav1st merged commit c1a3a6b into master Mar 22, 2022
@abhijeetkaurav1st abhijeetkaurav1st deleted the topic/dsl-changes-3.4.0 branch March 22, 2022 04:47
abhijeetkaurav1st added a commit that referenced this pull request Mar 9, 2023
(cherry picked from commit b4bf73baed2da24baab7fdec82d8a93a4ce958e5)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.