Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merge Azure into main #1223

Merged
merged 122 commits into from
Jun 6, 2024
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
122 commits
Select commit Hold shift + click to select a range
f668395
Merged PR 18269: Add wonen local env
NvdLaan Dec 6, 2023
86ca86c
change url
joeyamst Dec 11, 2023
4c03e1a
removed manifests and pipelines from repo - they are in salmagundi-in…
joeyamst Dec 18, 2023
97136b4
copy latest version from azdo
NvdLaan Dec 20, 2023
896b4ab
change requirements.txt
NvdLaan Dec 20, 2023
b6be453
fix cors
NvdLaan Dec 20, 2023
a15c43c
add ton to cors list
NvdLaan Jan 3, 2024
c6da680
fix openzaak check
NvdLaan Jan 4, 2024
f796ea1
health check fixes
NvdLaan Jan 4, 2024
7d83a3f
up the timeout
NvdLaan Jan 4, 2024
0bf71e4
set timeout equal to appgw timeout
NvdLaan Feb 6, 2024
668d765
fix cors
NvdLaan Feb 6, 2024
61015ba
merge fix
NvdLaan Feb 15, 2024
d3f25e7
add powerbrowser hc
NvdLaan Feb 15, 2024
fee8921
buffer-size
NvdLaan Feb 15, 2024
fbe3d27
enable debug
NvdLaan Feb 16, 2024
dbad6cf
disable debug again
NvdLaan Feb 16, 2024
3c1fdaa
enable appinsights
NvdLaan Feb 19, 2024
1de4c85
remove invalid log
NvdLaan Feb 19, 2024
d2a1300
add another handler
NvdLaan Feb 19, 2024
05ed932
log handler
NvdLaan Feb 19, 2024
9c88009
loglevel
NvdLaan Feb 19, 2024
6a70153
try root
NvdLaan Feb 19, 2024
4dba672
fix error
NvdLaan Feb 19, 2024
9371267
disable sentry
NvdLaan Feb 19, 2024
d172a56
debug it all
NvdLaan Feb 19, 2024
295bd52
integration
NvdLaan Feb 19, 2024
9471f3f
change middleware ordeR
NvdLaan Feb 19, 2024
22785d9
try unnamed
NvdLaan Feb 19, 2024
1415f49
try opentelemetry
NvdLaan Feb 20, 2024
410b26b
change dependencies
NvdLaan Feb 20, 2024
a08dd31
remove dependencies
NvdLaan Feb 20, 2024
14a83ff
dependency
NvdLaan Feb 20, 2024
86a0c86
dependency
NvdLaan Feb 20, 2024
21408b0
simplify for now
NvdLaan Feb 20, 2024
db90513
add more logging
NvdLaan Feb 20, 2024
455bbf2
uncomment
NvdLaan Feb 20, 2024
41159aa
add statement
NvdLaan Feb 20, 2024
926c874
change cmd
NvdLaan Feb 20, 2024
c12d1f7
Revert "try opentelemetry"
NvdLaan Feb 20, 2024
672dd72
try lazy-apps
NvdLaan Feb 20, 2024
200cf41
remove again
NvdLaan Feb 20, 2024
fcb9297
idk
NvdLaan Feb 20, 2024
032dd4c
disable more
NvdLaan Feb 20, 2024
d66598b
disable existing loggers
NvdLaan Feb 20, 2024
9568735
more debug
NvdLaan Feb 20, 2024
a1714a1
setup debug to true
NvdLaan Feb 20, 2024
dc58db5
add lazy again
NvdLaan Feb 20, 2024
4a8c626
disable debug again
NvdLaan Feb 20, 2024
c576bc9
level to info
NvdLaan Feb 20, 2024
fbf1ef0
disable lazy
NvdLaan Feb 20, 2024
60fd3b8
disable logging
NvdLaan Feb 20, 2024
af09d9f
disable trace
NvdLaan Feb 20, 2024
9d3575d
enable lazy again
NvdLaan Feb 20, 2024
0c800d1
play with uwsgi settings
NvdLaan Feb 20, 2024
0dc0464
enable logging again
NvdLaan Feb 20, 2024
7c554e1
add celery logging
NvdLaan Feb 21, 2024
afaa283
test if logging works
NvdLaan Feb 23, 2024
3cda183
fix celery logging
NvdLaan Feb 23, 2024
19566f5
play with config
NvdLaan Mar 5, 2024
1408fd3
change again
NvdLaan Mar 5, 2024
27fac58
experiment with old settings
NvdLaan Mar 8, 2024
9c45cce
performance test
NvdLaan Mar 11, 2024
78bcb69
revert
NvdLaan Mar 11, 2024
82c4468
add retries for redis connection
NvdLaan Mar 11, 2024
edd6c00
use old config
NvdLaan Mar 11, 2024
836469c
revert to lower amounts
NvdLaan Mar 11, 2024
8d732ce
disable things for performance tests
NvdLaan Mar 12, 2024
dd05e7e
decrease processes
NvdLaan Mar 12, 2024
aca0553
disable
NvdLaan Mar 12, 2024
b8e5889
enable cheaper-algo
NvdLaan Mar 12, 2024
2f4febd
enable again
NvdLaan Mar 12, 2024
38a9a10
lazy
NvdLaan Mar 12, 2024
cc4b12a
loglevels to debug
NvdLaan Mar 12, 2024
77a4bed
try using celery for the save
NvdLaan Mar 12, 2024
d3a7f6f
Revert "loglevels to debug"
NvdLaan Mar 12, 2024
39aac65
Revert "Revert "loglevels to debug""
NvdLaan Mar 12, 2024
6f4b7b8
Revert "try using celery for the save"
NvdLaan Mar 12, 2024
9910b28
change uwsgi
NvdLaan Mar 12, 2024
3f2900c
rebase
NvdLaan Mar 13, 2024
6ac5a83
keep more minimum workers
NvdLaan Mar 14, 2024
053a26c
celery settings
NvdLaan Mar 16, 2024
86cfe80
cors
NvdLaan Mar 21, 2024
3dcdacc
Swagger UI in DEBUG mode only
remyvdwereld Mar 23, 2024
b1d1313
read cors from settings
NvdLaan Apr 4, 2024
0639277
Local evironment settings
remyvdwereld Apr 18, 2024
a22d3fa
Changed docker compose to local file to prevent extra bs
remyvdwereld Apr 23, 2024
fae9404
Updated vars for local development
remyvdwereld Apr 24, 2024
e4b0256
fix lint
NvdLaan Apr 24, 2024
9533e56
fix another lint
NvdLaan Apr 24, 2024
18df4dc
Updated BRP url for ACC
remyvdwereld Apr 24, 2024
58f1b19
disable volume
NvdLaan Apr 25, 2024
70f638a
linting
NvdLaan Apr 25, 2024
bc22370
dc changes
NvdLaan Apr 25, 2024
301989d
disable volume
NvdLaan Apr 25, 2024
5ebbe8f
use local
NvdLaan Apr 25, 2024
671be4c
use local instead of test yaml
NvdLaan Apr 25, 2024
ab1ea76
change action
NvdLaan Apr 26, 2024
f697c41
fixes
NvdLaan Apr 26, 2024
703f089
use local
NvdLaan Apr 26, 2024
53554c1
more dc changes
NvdLaan Apr 26, 2024
f556b8a
change port
NvdLaan Apr 26, 2024
241c43f
revert
NvdLaan Apr 26, 2024
cb5c5dd
revert
NvdLaan Apr 26, 2024
cf94fde
add more debug info
NvdLaan Apr 29, 2024
df8f2d3
change step
NvdLaan Apr 30, 2024
79acf03
Updated timeout for BAG search
remyvdwereld May 6, 2024
1c9d796
115545
remyvdwereld May 12, 2024
ac675d7
Merge pull request #1228 from Amsterdam/feature/115545-add-tag-filter…
remyvdwereld May 12, 2024
99df812
Warnings processed
remyvdwereld May 14, 2024
d14437c
115625
remyvdwereld May 30, 2024
9f3cb94
Merge pull request #1233 from Amsterdam/feature/115625-change-bag-num…
remyvdwereld May 30, 2024
75ae3c6
change logging
NvdLaan Jun 5, 2024
fe49431
disable trace integrations
NvdLaan Jun 5, 2024
9a86273
change loglevel
NvdLaan Jun 5, 2024
471900a
try to filter queries
NvdLaan Jun 5, 2024
8c02e60
rm import
NvdLaan Jun 5, 2024
b87cf3d
disable more logs
NvdLaan Jun 5, 2024
22651ca
remove hc from logs
NvdLaan Jun 5, 2024
f47b432
rename
NvdLaan Jun 5, 2024
c6e2f89
linting
NvdLaan Jun 6, 2024
6060c2f
change processes
NvdLaan Jun 6, 2024
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
19 changes: 8 additions & 11 deletions .env
Original file line number Diff line number Diff line change
@@ -1,27 +1,28 @@
# Django environment variables
ENVIRONMENT=development
ENVIRONMENT=local
DJANGO_SECRET_KEY=local
UWSGI_HTTP=0.0.0.0:8000
UWSGI_STATIC_MAP=/static=/static
CORS_ORIGIN_WHITELIST=http://0.0.0.0:2999,http://localhost:2999,http://zaken-frontend.localhost,https://zaken-frontend.localhost
DATABASE_NAME=zaken
DATABASE_USER=zaken
DATABASE_PASSWORD=insecure
DATABASE_HOST=database
DATABASE_PORT=5432
SENTRY_DSN=https://[email protected]/0
LOCAL_DEVELOPMENT_AUTHENTICATION=True
LOGGING_LEVEL=DEBUG # To prevent flooding the logging in local development. Default is DEBUG.
SECRET_KEY_TOP_ZAKEN=SECRET_KEY_TOP_ZAKEN
SECRET_KEY_TON_ZAKEN=SECRET_KEY_TON_ZAKEN
BELASTING_API_URL=https://api-acc.belastingen.centric.eu/bel/inn/afne/vora/v1/vorderingenidentificatienummer/
BAG_API_SEARCH_URL=https://api.data.amsterdam.nl/atlas/search/adres/
BAG_API_NUMMERAANDUIDING_SEARCH_URL=https://api.data.amsterdam.nl/v1/bag/nummeraanduidingen/
BAG_API_BENKAGG_SEARCH_URL=https://api.data.amsterdam.nl/v1/benkagg/adresseerbareobjecten/
DECOS_JOIN_USERNAME=ZakenTop
DECOS_JOIN_PASSWORD=insecure
RABBIT_MQ_USERNAME=rabbit_zaken_user
RABBIT_MQ_PASSWORD=rabbit_zaken_password
RABBIT_MQ_URL=rabbitmq
RABBIT_MQ_PORT=5672
REDIS=default:password@zaak-redis:6379
REDIS_HOST=zaak-redis
REDIS_PORT=6379
REDIS_PASSWORD=password
DEFAULT_THEME=Vakantieverhuur
DEFAULT_REASON=SIA melding
VAKANTIEVERHUUR_TOERISTISCHE_VERHUUR_API_URL=https://api.acceptatie.toeristischeverhuur.nl/api/
Expand All @@ -45,12 +46,8 @@ POSTGRES_DB=zaken
POSTGRES_USER=zaken
POSTGRES_PASSWORD=insecure

# RabbitMQ service environment variables
DEFAULT_USER=rabbit_zaken_user
DEFAULT_PASS=rabbit_zaken_password

# OpenZaak environment variables
OPENZAAK_ENABLED=True
OPENZAAK_ENABLED=False
OPENZAAK_CATALOGI_URL=http://172.17.0.1:8000/catalogi/api/v1/catalogussen/c135a500-beac-4774-bc0d-b582630e605d
OPENZAAK_DEFAULT_INFORMATIEOBJECTTYPE=http://172.17.0.1:8000/catalogi/api/v1/informatieobjecttypen/b96d14b0-03ad-421a-bc7c-b501652a04b2
HOST=http://172.17.0.1:8080
Expand Down
2 changes: 1 addition & 1 deletion .github/workflows/e2e-tests.yml
Original file line number Diff line number Diff line change
Expand Up @@ -22,7 +22,7 @@ jobs:

- run: docker network create zaken_network
- run: docker network create top_and_zaak_backend_bridge
- run: docker-compose -f docker-compose.test.yml up --detach
- run: docker-compose -f docker-compose.local.yml up --detach
- run: sleep 30
- run: bash bin/setup_credentials.sh
- run: ./e2e-tests/fix_models.sh
Expand Down
2 changes: 1 addition & 1 deletion .github/workflows/integration-tests.yml
Original file line number Diff line number Diff line change
Expand Up @@ -28,7 +28,7 @@ jobs:
- run: docker network create top_and_zaak_backend_bridge
working-directory: backend

- run: docker-compose up --build --detach
- run: docker-compose -f docker-compose.local.yml up --build --detach
working-directory: backend

###################################################
Expand Down
4 changes: 2 additions & 2 deletions .github/workflows/main.workflow.yml
Original file line number Diff line number Diff line change
Expand Up @@ -17,12 +17,12 @@ jobs:
- name: Linting
run: bash bin/cleanup_pre_commit.sh
- name: Build Docker image
run: docker-compose build
run: docker-compose build -f docker-compose.local.yml
- name: Create Docker network
run: docker network create zaken_network
- name: Create TOP and Zaken Docker network
run: docker network create top_and_zaak_backend_bridge
- name: Start images
run: docker-compose up -d
run: docker-compose -f docker-compose.local.yml up -d
- name: Run Tests
run: docker-compose exec -T zaak-gateway python manage.py test
126 changes: 0 additions & 126 deletions Jenkinsfile

This file was deleted.

47 changes: 47 additions & 0 deletions Makefile
Original file line number Diff line number Diff line change
@@ -0,0 +1,47 @@
.PHONY: manifests deploy

dc = docker-compose

ENVIRONMENT ?= local
HELM_ARGS = manifests/chart \
-f manifests/values.yaml \
-f manifests/env/${ENVIRONMENT}.yaml \
--set image.tag=${VERSION}

REGISTRY ?= 127.0.0.1:5001
REPOSITORY ?= salmagundi/zaken-backend
VERSION ?= latest

build:
$(dc) build

test:
echo "No tests available"

migrate:

push:
$(dc) push


manifests:
@helm template wonen $(HELM_ARGS) $(ARGS)

deploy: manifests
helm upgrade --install wonen $(HELM_ARGS) $(ARGS)

update-chart:
rm -rf manifests/chart
git clone --branch 1.5.2 --depth 1 [email protected]:Amsterdam/helm-application.git manifests/chart
rm -rf manifests/chart/.git

clean:
$(dc) down -v --remove-orphans

reset:
helm uninstall wonen

refresh: reset build push deploy

dev:
nohup kubycat kubycat-config.yaml > /dev/null 2>&1&
4 changes: 2 additions & 2 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -45,13 +45,13 @@ First, make sure you have built the project and executed the database migrations
```
docker network create top_and_zaak_backend_bridge
docker network create zaken_network
docker compose build
docker-compose -f docker-compose.local.yml build
```

Start AZA backend:

```
docker compose up
docker-compose -f docker-compose.local.yml up
```

To create all necessary credentials run the following command:
Expand Down
4 changes: 3 additions & 1 deletion app/Dockerfile
Original file line number Diff line number Diff line change
Expand Up @@ -30,4 +30,6 @@ RUN chmod +x /app/wait-for.sh
RUN chmod +x /app/celery.sh
RUN chmod +x /app/deploy/docker-entrypoint.sh

CMD ["bash", "/app/deploy/docker-entrypoint.sh"]

ENTRYPOINT ["/app/deploy/docker-entrypoint.sh"]
CMD ["uwsgi", "--ini", "/app/deploy/config.ini"]
Loading
Loading