Merge develop into master #602
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
- Added changelog - Added versions to for components - Minor documentation updates - Removed unused documentation
* Updated documentation - Added changelog - Added versions to for components - Minor documentation updates - Removed unused documentation * Fixed links. * Fixed changelog. * Added node_exporter port known issue. * Added new terraform-bin plugin and updated templates to 0.12.6
* Item: #410 Desc: Add ports for node_exporter and kafka_exporter * Item: #274 Desc: List ports used by Epiphany in documentation. * Item: #000 Desc: Fix after merge * Item: #274 Desc: Changes required by pull request - remove TCP from docs for kubernetes * Item: #274 Desc: Changes required by pull request - information about defaults
* - Added login to Azure-CLI and selection of subscription. - Added creation of service principle. - Added creation of the resource group. * - Added posibility to run without service principal * - Changed text outputs * - Fixed typo.
- Added Added VS Remote-Containers development - Cleaned up some files - Fixed terraform schema change where it could not find the key after subsequent build - Set fixed version of python to 3.7
* Updated documentation - Added changelog - Added versions to for components - Minor documentation updates - Removed unused documentation * Fixed links. * Fixed changelog. * Added node_exporter port known issue. * Updates for Azure provider. - Added pylint to devdocker for better coding in VSCode (Should be PEP8 but that has some issues for now) - Moved AzureCommand to APIProxy to be in line with other AWS and any provider - Filled in Azure provider blanks so entire run will pass. - Added .devcontainer and .vscode to gitignore so people don't accidently push changes for VSCode workspace.
- Added delete command - Minor refactoring of engine files - Fixed issue with ObjDict. - Refactored paths calculation for DeleteEngine - Refactored PatchEngine input. - Refactored PatchEngine copy and run structure. - Restructure projects - Fixing test - Minor fix for resource-group name.
- Moved resource group creation to separate model - Added creation of VNET - Fixed env variables Azure with SP login - Fixed some typos
- Simplified error handling by moving it to the root of all CLI paths - Added debug flag to output debug info. (including Terraform and Ansible) - Added auto-approve flag to CLI - Fixed Terraform Azure issue where creating additional resources after resource group would fail because the resource group was not ready jet. - Updated/Improved/Added various unit tests
* Removing the test environment destruction function * HAProxy and Prometheus test fixes
- Fixed typo for rabbitmq machine
* Fixed link to container-selinux package
- Restructure documentation separating Epicli and Legacy - Broke down HOWTO document in separate documents - Updated readme.md - Fixed docker tag/run commands with TAG information. - Added 'How to create an Epiphany cluster on existing infrastructure' article for Epicli - Added article to delete a cluster from a cloud provider - Started with an Article to create a cloud provider - Added 'How to create an Epiphany cluster on a cloud provider' for Epicli
- Fixes for SP login. - Fixed exit code issue with Ansible. - Fixed break.
* Commit forgotten file.
Fix/skopeo and cluster prefix
* Fixed naming issues and added conventions: - validator fixes - prefix field validation - cluster name field validation - cluster tag fixes * Minor update for storage account naming and tests.
* FIxes: - Init issues for different providers - Link in docs * Added ports for clustering Postgres and RabbitMQ
* - Updated changelog * Added article for up/downscaling, clustering components. * Added article for offline installation.
* Added download role * Kubernetes install packages, dependencies list added * Loading images from download cache- Kubernetes role * Docker installation from offline * Added download role * Commit to store prototype (temporary changes) * Updated prototype * sync -> copy + improvements * The same package for multiple OS distros handled * Grafana offline mode install, docker offline fixes * ELK, HAProxy, Postgresql moved to offline installation * RabbitMQ package installation offline mode * HAProxy experimental binary install (offline mode) * RabbitMQ offline, HAProxy offline binary install (#473) * RabbitMQ package installation offline mode * HAProxy experimental binary install (offline mode) * Added links to kibana, haproxy, filebeat, elasticsearch, grafana, docker packages (#474) * Added links to haproxy_exporter and rabbitmq packages (#476) * Offline mode for (file install): elacticsearch-curator, haproxy_exporter, jmx_exporter, kafka, node_exporter * Fixes for downloading packages and installing Docker on Ubuntu (#480) * Updated variable names for dest dirs * Fixes for downloading packages * Prometheus, AlertManager and ZooKeeper move to offline mode * Tasks for downloading all files and improvements (#412) * Added links to postgresql, zookeeper, kafka, prometheus, exporter packages (#484) * Exact version match (#485) * Exact version match (#412) * Simplified setting properties (#412) * Fix: Prevent docs duplication in manifest * Remote_src fix in unarchive, haproxy and haproxy_exporter validated * [Offline-mode] ELK stack updated * Fixes for offline mode with packages and files * Kubernetes installation of deb package fix * Download all packages + fix for admin_user (#504) * Feature/offline-mode - added image download capability (#486) * image download capability added * multiple fixes and multi-arch support added * Added links to Kubernetes packages (#502) * Removing the test environment destruction function * Added links to kibana, haproxy, filebeat, elasticsearch, grafana, docker packages * Added links to haproxy_exporter and rabbitmq packages * Added links to haproxy_exporter and rabbitmq packages * Added links to postgresql packages * Added links to postgresql packages * Added links to postgresql packages * Added links to zookeeper, kafka, exporter packages * Added links to Kubernetes packages * replaced sha512 with file_name * More fixes to offline mode (#503) * Fix: Prevent docs duplication in manifest * Remote_src fix in unarchive, haproxy and haproxy_exporter validated * [Offline-mode] ELK stack updated * Fixes for offline mode with packages and files * Kubernetes installation of deb package fix * Removed test data (#412) (#505) * Feature/offline-mode - image download tweaks, added configuration example (#507) * change url to full docker registry path with version tag, added configuration examples * removal of unnecessary quotations, silenced ansible warning * Kafka, Kafka exporter, postgresql and install role * Add offline-mode flag to epicli * Add offline mode to AnsibleVarsGenerator * Add offline flag for epicli (#510) * Add offline-mode flag to epicli * Add offline mode to AnsibleVarsGenerator * Installing packages + files + images using artifacts repository * Installing packages + files + images using artifacts repository (#512) * Rewrote: postgress, haproxy and haproxy_exporter. * Prometheus, Grafana, Exporters, Kafka, Zookeeper to use private repo * Kafka exporter moved to private repo * Rewrote: postgress, haproxy and haproxy_exporter. (#514) * Missing flannel image definition in K8s configuration * Download role cleanup * Install role cleanup * Add stub of repositories role * Fixed feature mapping yaml * Updated elk, Kibana, Filebeat, elk-curator. * Added file_name for haproxy-exporter * Roles to use private repo (#515) * Installing packages + files + images using artifacts repository * Prometheus, Grafana, Exporters, Kafka, Zookeeper to use private repo * Kafka exporter moved to private repo * Missing flannel image definition in K8s configuration * Download role cleanup * Install role cleanup * Fixed feature mapping yaml * Feature/offline mode (#516) - Updated elk, Kibana, Filebeat, elk-curator - Added file_name for haproxy-exporter * Add setup and teardown to Epiphany role * Add integration to repository role with epicli * Change repository configuration to take files from kubernetes master server * Fixed remove of node_exporter endpoint accessibility on kubernetes master for default configuration * Add offline/online mode for Red Hat (#519) * Added prepare command to prepare offline repo scripts. * - Updated RabbitMQ roll to pull stuff from repo. * Add scopeo copying (#521) * Add offline/online mode for Red Hat * Add skopeo copy and stub of task for Debian * Copy scopeo to upload dir * Add new structure of files to repository role (#522) * Add offline/online mode for Red Hat * Add skopeo copy and stub of task for Debian * Copy scopeo to upload dir * Changed repository script structure * Move repository scripts * Add directories copy for new data structure * Fixes for Red Hat script * Refactor of repository role. * Refactored stuff. * download-requirements.sh for CentOS-7 (#513) (#526) download-requirements.sh for CentOS-7 * Started refactoring repository role. (#527) * Refactor of repository role. * Refactored stuff. * Run download-requirements.sh from any location (#528) Run download-requirements.sh from any location * Move Skopeo for copying to repo host and add message for long running repo task. * Feature/offline mode (#529) - Move Skopeo for copying to repo host and add message for long running repo task. * Offline progress - Changed offline_mode to offline_requirements accepting a path param. - Removed old offline mode code - Removed useless checks for AnsibleVarsGenerator.py * Minor message update. * Feature/offline mode (#530) - Changed offline_mode to offline_requirements accepting a path param. - Removed old offline mode code - Removed useless checks for AnsibleVarsGenerator.py * Offline progress - Fix for local epi-repo path. - Cleaned up old code. * Feature/offline mode (#531) - Fix for local epi-repo path. - Cleaned up old code. * Refactoring repository role (#532) - Refactoring repository role * Changes in repository role (#533) * Redirect STDERR to STDOUT for logging * Fix for packages containing 'error' in name * Added Perl as dependency for vim * Fix for 'ERROR 403: Forbidden' on AWS * Added python-firewall for firewalld * Added dependencies for vim * - Minor fixes after merge with develop * Fixed version numbers. * More dependencies for vim (#538) * Merged develop into feature/offline + some fixes (#539) * Updated documentation - Added changelog - Added versions to for components - Minor documentation updates - Removed unused documentation * Fixed links. * Fixed changelog. * Added node_exporter port known issue. * Feature/skopeo (#475) * Updated documentation - Added changelog - Added versions to for components - Minor documentation updates - Removed unused documentation * Fixed links. * Fixed changelog. * Added node_exporter port known issue. * - Added Skopeo minor update to devcontainer. * subnets, network interfaces, security rules, ansible inventory (#469) Fixes for subnets Fixed versions for Terraform providers for both Azure and AWS Added VMs Added network interfaces Added security rules Added ansible inventory generation * File generating hashes for directory (#477) * Item: #422 Desc: Add missing ports for prometheus and grafana * Item: #0000 Desc: File hash generator for directory * Item: #0000 Desc: Moved folder to new structure * Testruns (#506) - Added running of python unit tests via debug config in VSCode - Added running of serverspec tests via debug config in VSCode - Documentation * Release prep part 1 (#501) * Updated documentation - Added changelog - Added versions to for components - Minor documentation updates - Removed unused documentation * Fixed links. * Fixed changelog. * Added node_exporter port known issue. * Preparation for release. * Feature/azure-k8n-storage (#487) - Added shared storage for k8n * Azure rehat fixes (#511) Fix for container-selinux package on redhat. Fixes for HAProxy and Posgress on Azure. Fix for running tests from VSCode. * Fix typo rabbitmq (#518) * Fix/rabbitmq error (#523) - Fixed typo for rabbitmq machine * Fixed link to container-selinux package (legacy) (#525) * Fixed link to container-selinux package * Refactor of repository role. * Refactored stuff. * Move Skopeo for copying to repo host and add message for long running repo task. * Offline progress - Changed offline_mode to offline_requirements accepting a path param. - Removed old offline mode code - Removed useless checks for AnsibleVarsGenerator.py * Minor message update. * Offline progress - Fix for local epi-repo path. - Cleaned up old code. * - Minor fixes after merge with develop * Fixed version numbers. * Debian scripts for download * Reverted temp changes * Review changes * Changed scripts fore Debian packages (#540) * Installing packages + files + images using artifacts repository * Prometheus, Grafana, Exporters, Kafka, Zookeeper to use private repo * Kafka exporter moved to private repo * Missing flannel image definition in K8s configuration * Download role cleanup * Install role cleanup * Fix for dependencies to be downloaded (#544) * uniq -> 'sort --unique' * Updated package dependencies * Remove trailing spaces * java-1.8.0-openjdk -> java-1.8.0-openjdk-headless * Refactored repository role, changes for RHEL (#547) * Refactored repository role, changes for RHEL #536 * Changed directories structure for tasks #536 * Added repository role to feature mappings #536 * Fix for removing flag file if expired #536 * Added wget #536 * Minor fix for prepare when output dir is not supplied. * Minor fix for prepare paths (#550) - Minor fix for prepare when output dir is not supplied. * Offline mode - progress for RedHat (#552) * Added --log-to-journal option #536 * download-requirements script logs to journal #536 * Added python-slip-dbus for firewalld on AWS #536 * Disabled repository role in feature mappings #536 * Static version for docker-ce #536 * download-reqs: yum makecache fast -> yum makecache #536 * Do not install epel-release #536 * Download latest versions of dependencies #536 * Optimizations and better naming #536 * Colons -> hyphens in file names of images #536 * jmx_prometheus_javaagent v0.12.0 #536 * Better task names in zookeeper role * Offline mode progress (#555) * yum makecache -> yum makecache fast #536 * Added versions for docker-ce & docker-ce-cli #536 * Added property 'download_done_flag_expire_minutes' #536 * enabled-system-repos.txt in /var/tmp #536 * Clean up temporary files #536 * Added execution time #536 * Fixes for Azure in repository role #536 * Fixes for centos offline mode * Fixes for offline centos (#577) * Installing packages + files + images using artifacts repository * Prometheus, Grafana, Exporters, Kafka, Zookeeper to use private repo * Kafka exporter moved to private repo * Missing flannel image definition in K8s configuration * Download role cleanup * Install role cleanup * Fixed feature mapping yaml * Debian scripts for download * Reverted temp changes * Review changes * Fixes for centos offline mode * Fixes for offline mode for RedHat after testing (#579) * Improvements after testing #536 * Rabbitmq and Erlang in fixed version #536 * Added --cacheonly to yum repolist #536 * Removed old structure #536 * Local docker registry for controlplane images * Change comment for custom_image_registry Co-Authored-By: to-bar <[email protected]> * Skip downloading when image exists #536 * Fix in repository teardown #536 * Missing coredns images, flannel installation fix * WIP: Feature/offline Ubuntu part (#580) * offline repo for ubuntu - merge scripts into repository role - initial support * requirements and repo creation fixes * ubuntu offline-online installation works * apt-cache policy not needed here * cleanups * added missing bash error handling * added removal of 3rd party repos, other cleanups, install wget and gpg for minimal OS * fix for running script from different location (#583) * Fixes for offline mode for RedHat and CentOS (#585) * Fix for hosts without yum-utils package #536 * Fixes for repo prereqs and image permissions #536 * Offline mode Ubuntu part - fixes (#587) * fix for running script from different location * fixed skopeo .tar permissions to 644 * added missing dependencies for jq * Fix/offline ubu (#588) * fix for running script from different location * fixed skopeo .tar permissions to 644 * added missing dependencies for jq * bootstrap apache and dpkg-dev installation in air-gap mode * Requirements and repo creation for centos * Added missing file * Requirements and repo creation for centos (#589) * Requirements and repo creation for centos * Added missing file * Added NSG rules for image repository and package repository * Added security rules to AWS and fixed on Azure * Added security rules to AWS and fixed on Azure (#591) * Offline mode Ubuntu part - fixes for air-gap mode, install libdpkg-perl (#592) * fixes for air-gap mode, install libdpkg-perl * unified stderr to stdout bash pipe with rhel version of this script * convoluted comments are convoluted * added missing dependencies * Change name for RedHat filebeat * File name typo fix (#593) * Changed name to fix again... * Fixed name for RedHat in rabbitmq tasks. * Epicli validation and RabbitMQ and Postgress cluster fixes. (#595) * Ensure httpd is running * Ensure httpd is running (#597) * Ensure httpd is running * Added killing of the previous instance for Ansible * Set up sysctl params for K8s * Fix/offline ubu (#599) * fixes for air-gap mode, install libdpkg-perl * unified stderr to stdout bash pipe with rhel version of this script * convoluted comments are convoluted * added missing dependencies * added dependencies for postgresql-10 and gpg/gnupg * Fixed default HAProxy config * Fix/offline last minute improvements (#601) * fixes for air-gap mode, install libdpkg-perl * unified stderr to stdout bash pipe with rhel version of this script * convoluted comments are convoluted * added missing dependencies * added dependencies for postgresql-10 and gpg/gnupg * restore system repos if missing, logging improvements * Fix in enable-system-repos.sh for RHEL (#604) * Merged develop into offline. (#605) * Fix/aws ports and naming (#576) * FIxes: - Init issues for different providers - Link in docs * Added ports for clustering Postgres and RabbitMQ * RabbitMQ test fix for AWS hostnames (#578) * Test fix - added regexp to eliminate false negatives in particular cases (#586) * Feature/doc updates (#584) * - Updated changelog * Added article for up/downscaling, clustering components. * Added article for offline installation. * removal of unneeded code from Ubuntu 16.04 era (#606)
erzetpe
approved these changes
Oct 11, 2019
lukurde
approved these changes
Oct 11, 2019
to-bar
pushed a commit
to to-bar/epiphany
that referenced
this pull request
May 6, 2020
Merge develop into master
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
No description provided.