Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merge develop to master branch after 0.7.1 release. #1557

Merged
merged 70 commits into from
Aug 13, 2020
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
70 commits
Select commit Hold shift + click to select a range
9f4ebc1
Initialized test status table
mkyc Jul 3, 2020
e4a9f23
Added next sections of test status
mkyc Jul 3, 2020
9345c8d
Upgrade cluster section filled
mkyc Jul 3, 2020
58111f3
All sections filled
mkyc Jul 6, 2020
592b8af
Add missing tests
mkyc Jul 6, 2020
ffb2a60
Merge pull request #1425 from mkyc/tests-matrix
mkyc Jul 6, 2020
3c0b096
Move CNS proposition design doc to GH.
mkyc Jul 6, 2020
6a85bcd
fixed formatting
mkyc Jul 6, 2020
57a2282
Etcd encryption feature refactor for deployment and upgrades (#1427)
sk4zuzu Jul 8, 2020
35c1f5e
Merge pull request #1426 from mkyc/persistence-layer
mkyc Jul 8, 2020
405176b
Bumping AzureCLI to fix SP secrets with special characters.
seriva Jul 9, 2020
a543f5f
Added Changelog entry.
seriva Jul 9, 2020
8b01341
Change move to copy build dir during an upgrade (#1429)
rafzei Jul 9, 2020
5048fae
Update to logging
seriva Jul 9, 2020
f3caf64
helm documentation #896
Jul 10, 2020
b666a8a
Progress:
seriva Jul 10, 2020
6d16067
Fix K8s upgrade: 'kubeadm upgrade apply' hangs (#1431)
to-bar Jul 10, 2020
8f4239e
Rename vendor in VSCode recommendations (#1438)
jetalone85 Jul 13, 2020
263e182
Fix issue with Vault and Kubernetes Calico/Canal communication (#1434)
erzetpe Jul 13, 2020
a40c17a
Added changelog.
seriva Jul 14, 2020
237a8c5
Merge branch 'develop' into fix/1424
seriva Jul 14, 2020
e17b3bb
Merge pull request #1437 from seriva/fix/1424
seriva Jul 14, 2020
391b94d
Merge branch 'develop' into fix/1423
seriva Jul 14, 2020
c032996
Merge pull request #1432 from seriva/fix/1423
seriva Jul 14, 2020
11c15e7
add howto links for helm doc
Jul 14, 2020
dfcb1cf
Update Changelog for #1438 (#1460)
jetalone85 Jul 14, 2020
16014d2
bump rabbitmq version from 3.7.10 to 3.8.3 #1395
Jul 14, 2020
6ed461b
Changes in documentation after creating fix for calico and canal (#1459)
erzetpe Jul 15, 2020
1f35823
Merge pull request #1435 from ar3ndt/helm_documentation
ar3ndt Jul 16, 2020
d359bb4
Got rid of pipe and grep (#1472)
rafzei Jul 17, 2020
9fd78b6
Assert that current version is upgradeable #1474 (#1476)
rafzei Jul 22, 2020
b19afc8
Add docker_version variable support (#1477)
gdajuk Jul 22, 2020
6da1518
Kubernetes HA upgrades (#1456)
sk4zuzu Jul 23, 2020
080ea76
Fix upgrade of flannel to v0.12.0 (#1484)
to-bar Jul 27, 2020
3e68564
Readme and changelog update (#1493)
rafzei Jul 29, 2020
11227b6
Fixing broken offline CentOS 7.8 installation (#1498)
sk4zuzu Jul 29, 2020
b2deae6
Add modularization-approaches.md design document
mkyc Jul 29, 2020
d543c1f
Kibana config always points its elasticsearch.hosts to a "logging" VM…
rafzei Jul 30, 2020
38c6dfe
Bump elliptic from 6.5.0 to 6.5.3 in /examples/keycloak/implicit/react
dependabot[bot] Jul 31, 2020
4351a97
Bump elliptic in /examples/keycloak/authorization/react
dependabot[bot] Jul 31, 2020
dcca81c
Always setting hostname on all nodes of the cluster (on-prem fix) (#1…
sk4zuzu Jul 31, 2020
e1219af
Workarund restart rabbitmq pods during patching #1395
Jul 20, 2020
3142426
add missing changelog entry
Jul 31, 2020
bec0b87
Merge pull request #1514 from epiphany-platform/dependabot/npm_and_ya…
mkyc Jul 31, 2020
b84e02d
Merge pull request #1515 from epiphany-platform/dependabot/npm_and_ya…
mkyc Jul 31, 2020
d748872
Upgrade Kubernetes to v1.18.6 (#1501)
to-bar Jul 31, 2020
ef6e57d
Upgrade k8s-dashboard to v2.0.3 (#1516)
to-bar Jul 31, 2020
2d53074
fix due to review
Jul 31, 2020
7ecf444
Merge pull request #1508 from mkyc/spike/1462-approaches-comparision
mkyc Aug 4, 2020
4387843
Dashboard unavailability, network fix for Flannel and Canal #1394 (#1…
rafzei Aug 4, 2020
9f469a4
additional defaults for kafka config
Aug 5, 2020
f7fb93c
fixes after review, remove redundant code
Aug 6, 2020
78cbb2a
Merge pull request #1464 from epiphany-platform/feature/bump-rabbitmq…
ar3ndt Aug 6, 2020
3810375
Merge pull request #1529 from ar3ndt/kafka_additional_defaults
ar3ndt Aug 7, 2020
fcfbe39
Named demo configuration the same as generated one
tolikt Aug 7, 2020
3f94597
Added deletion step description
tolikt Aug 7, 2020
5cc61bf
Added a note related to versions for upgrades
tolikt Aug 7, 2020
fd7d82a
Fixed syntax errors
tolikt Aug 7, 2020
619a6a4
Added prerequisites section in upgrade doc
tolikt Aug 7, 2020
01488cb
Added key encoding troubleshooting info
tolikt Aug 7, 2020
ccd354b
Merge pull request #1536 from TolikT/feature/update-doc
mkyc Aug 10, 2020
c3295a0
Test fixes for RabbitMQ 3.8.3 (#1533)
przemyslavic Aug 10, 2020
19e43a5
Merge pull request #1492 from epiphany-platform/hotfix/rabbitmq-resta…
ar3ndt Aug 10, 2020
6801b3e
fix missing variable image rabbitmq
Aug 10, 2020
f4e3982
Merge pull request #1540 from ar3ndt/fix_rabbitmq_restart_pods
ar3ndt Aug 10, 2020
9ffa891
Add Kubernetes Dashboard to COMPONENTS.md (#1546)
rafzei Aug 11, 2020
2e4ce10
Update CHANGELOG-0.7.md
seriva Aug 11, 2020
bbc7062
Merge pull request #1547 from epiphany-platform/minor-changelog-patch
seriva Aug 11, 2020
038133b
CHANGELOG-0.7.md update v0.7.1 release date (#1552)
rafzei Aug 12, 2020
6b8a96e
Increment version string to 0.7.1 (#1554)
rafzei Aug 12, 2020
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
34 changes: 32 additions & 2 deletions CHANGELOG-0.7.md
Original file line number Diff line number Diff line change
@@ -1,5 +1,35 @@
# Changelog 0.7

## [0.7.1] 2020-08-12

### Added

- Minor logging improvements added while fixing issue [#1424](https://github.com/epiphany-platform/epiphany/issues/1424)
- [#1438](https://github.com/epiphany-platform/epiphany/pull/1438) - Rename Terraform plugin vendor in VSCode recommendations
- [#1413](https://github.com/epiphany-platform/epiphany/issues/1413) - Set protocol for Vault only in one place in configuration
- [#1423](https://github.com/epiphany-platform/epiphany/issues/1423) - Error reading generated service principal

### Updated

- [#1479](https://github.com/epiphany-platform/epiphany/issues/1479) - Upgrade K8s to v1.18.6
- [#1510](https://github.com/epiphany-platform/epiphany/issues/1510) - Upgrade Kubernetes Dashboard to v2.0.3

### Fixed

- [#1424](https://github.com/epiphany-platform/epiphany/issues/1424) - Terraform returning an error during deployments on Azure ("A retryable error occurred.")
- [#1399](https://github.com/epiphany-platform/epiphany/issues/1399) - Epicli upgrade: Kubernetes upgrade may hang
- [#1398](https://github.com/epiphany-platform/epiphany/issues/1398) - Vault installation fails when using canal/calico network plugin
- [#1412](https://github.com/epiphany-platform/epiphany/issues/1412) - Certificate in Vault is also generated or copied even if flag in configuration tls_disable is set to true
- [#1408](https://github.com/epiphany-platform/epiphany/issues/1408) - Epicli upgrade: Epiphany does not support upgrades for Kubernetes in HA mode
- [#1482](https://github.com/epiphany-platform/epiphany/issues/1482) - Epicli upgrade: flannel CNI plugin is not upgraded to v0.12.0
- [#1462](https://github.com/epiphany-platform/epiphany/issues/1461) - Epicli upgrade: [AWS/RHEL/calico] Upgrading cluster from 0.6 to 0.7 fails
- [#1072](https://github.com/epiphany-platform/epiphany/issues/1072) - [AWS/RHEL] Cluster networking issues/lags when using flannel/canal plugin
- [#802](https://github.com/epiphany-platform/epiphany/issues/802) - Docker version is hard-coded in installation tasks
- [#1495](https://github.com/epiphany-platform/epiphany/issues/1495) - Offline installation is broken for CentOS 7.8 environments
- [#1347](https://github.com/epiphany-platform/epiphany/issues/1347) - Kibana config always points its elasticsearch.hosts to a "logging" VM
- [#1336](https://github.com/epiphany-platform/epiphany/issues/1336) - Deployment of version 0.7.0 failed on-prem (spec.hostname)
- [#1394](https://github.com/epiphany-platform/epiphany/issues/1394) - Cannot access Kubernetes dashboard after upgrading

## [0.7.0] 2020-06-30

### Added
Expand Down Expand Up @@ -33,7 +63,8 @@
- [#1180](https://github.com/epiphany-platform/epiphany/issues/1180) - Update list of ports used by Epiphany components
- [#1310](https://github.com/epiphany-platform/epiphany/issues/1310) - Updated Azure-cli from 2.0.67 to 2.6.0
- [#1330](https://github.com/epiphany-platform/epiphany/issues/1330) - Update cloud based OS images
- [#1138](https://github.com/epiphany-platform/epiphany/issues/1138) - Upgrade Kubernetes to 1.17.7
- [#1138](https://github.com/epiphany-platform/epiphany/issues/1138) - Upgrade Kubernetes to 1.17.70
- [#1395](https://github.com/epiphany-platform/epiphany/issues/1395) - Upgrade RabbitMQ from 3.7.10 to 3.8.3

### Fixed

Expand All @@ -48,7 +79,6 @@
- [#1372](https://github.com/epiphany-platform/epiphany/issues/1372) - [BUG] Epicli does not create Postgresql SET\_BY\_AUTOMATION values correctly
- [#1373](https://github.com/epiphany-platform/epiphany/issues/1373) - [BUG] permission denied for shared directory in the container when no volume was mounted
- [#1385](https://github.com/epiphany-platform/epiphany/issues/1385) - [BUG] Regression issue with disabling etcd encryption
- [#1399](https://github.com/epiphany-platform/epiphany/issues/1399) - [BUG] Epicli upgrade issue - the process hangs for several hours on the task kubeadm upgrade apply

### Known Issues

Expand Down
39 changes: 30 additions & 9 deletions README.md
Original file line number Diff line number Diff line change
@@ -1,17 +1,26 @@
# Documentation
# Epiphany Platform
[![GitHub release](https://img.shields.io/github/v/release/epiphany-platform/epiphany.svg)](https://github.com/epiphany-platform/epiphany/releases)
[![Github license](https://img.shields.io/github/license/epiphany-platform/epiphany)](https://github.com/epiphany-platform/epiphany/releases)

## Overview

Epiphany at its core is a full automation of Kubernetes and Docker plus additional builtin services/components like:

- Kafka or RabbitMQ for high speed messaging/events
- Prometheus and Alertmanager for monitoring with Graphana for visualization
- Elasticsearch and Kibana for centralized logging
- Elasticsearch and Kibana for centralized logging (OpenDistro)
- HAProxy for loadbalancing
- Postgress for storage
- Postgres and Elasticsearch for data storage
- KeyCloak for authentication
- Vault (MVP) for protecting secrets and other sensitive data
- Helm as package manager for Kubernetes

Epiphany can run on as few as one node (laptop, desktop, server) but the real value comes from running 3 or more nodes for scale and HA. Nodes can be added or removed at will depending on data in the manifest. Everything is data driven so simply changing the manifest data and running the automation will modify the environment.
The following target platforms are available: AWS, Azure and on-prem installation.

Epiphany can run on as few as one node (laptop, desktop, server) but the real value comes from running 3 or more nodes for scale and HA. Everything is data driven so simply changing the manifest data and running the automation will modify the environment.
Kubernetes hosts (masters, nodes) and component VMs can be added depending on data in the initial manifest. More information [here](https://github.com/epiphany-platform/epiphany/blob/develop/docs/home/howto/CLUSTER.md#how-to-scale-or-cluster-components).

Please note that currently Epiphany supports only creating new masters and nodes and adding them to the Kubernetes cluster. It doesn't support downscale. To remove them from Kubernetes cluster you have to do it manually.

We currently use Terraform and Ansible for our automation orchestration. All automation is idempotent so you can run it as many times as you wish and it will maintain the same state unless you change the data. If someone makes a "snow flake" change to the environment (you should never do this) then simply running the automation again will put the environment back to the desired state.

Expand Down Expand Up @@ -41,13 +50,25 @@ This minimum file definition is fine to start with, if you need more control ove
epicli init -p aws -n demo --full
```

You will need to modify a few values (like your AWS secrets, directory path for SSH keys). Once you are done with `demo.yaml` you can start cluster deployment by executing:
You will need to modify a few values (like your AWS secrets, directory path for SSH keys). Once you are done with `demo.yml` you can start cluster deployment by executing:

```shell
epicli apply -f demo.yaml
epicli apply -f demo.yml
```
You will be asked for a password that will be used for encryption of some of build artifacts. More information [here](docs/home/howto/SECURITY.md#how-to-run-epicli-with-password)

Since version 0.7 epicli has an option to backup/recovery some of its components. More information [here](https://github.com/epiphany-platform/epiphany/blob/develop/docs/home/howto/BACKUP.md)
```shell
epicli backup -f <file.yml> -b <build_folder>
epicli recovery -f <file.yml> -b <build_folder>
```

To delete all deployed components following command should be used

```shell
epicli delete -b <build_folder>
```

Find more information using table of contents below - especially the [How-to guides](docs/home/HOWTO.md).

## Documentation
Expand All @@ -59,8 +80,8 @@ Find more information using table of contents below - especially the [How-to gui
- [How-to guides](docs/home/HOWTO.md)
- [Components](docs/home/COMPONENTS.md)
- [Security](docs/home/SECURITY.md)
- [Troubleshooting](docs/home/TROUBLESHOOTING.md)
- [Changelog](CHANGELOG.md)
- [Troubleshooting](docs/home/TROUBLESHOOTING.md)
- [Changelog](CHANGELOG.md)
- Architecture
- [Logical View](docs/architecture/logical-view.md)
- [Process View](docs/architecture/process-view.md)
Expand All @@ -69,5 +90,5 @@ Find more information using table of contents below - especially the [How-to gui
- [Governance model](docs/home/GOVERNANCE.md)
- [Development environment](docs/home/DEVELOPMENT.md)
- [GIT Workflow](docs/home/GITWORKFLOW.md)

<!-- TOC -->
2 changes: 1 addition & 1 deletion core/src/epicli/.devcontainer/Pipfile
Original file line number Diff line number Diff line change
Expand Up @@ -11,7 +11,7 @@ jsonschema = "*"
python-json-logger = "*"
ansible = "==2.8.8"
terraform-bin = "*"
azure-cli = "==2.6.0"
azure-cli = "==2.8.0"
skopeo-bin = "*"
"ruamel.yaml" = "*"

Expand Down
Loading