Skip to content

Commit

Permalink
Merge branch 'main' into 753-validate-taptarget-config-options
Browse files Browse the repository at this point in the history
  • Loading branch information
edgarrmondragon committed Aug 9, 2022
2 parents d1c3fa8 + eb024bd commit 07464d7
Show file tree
Hide file tree
Showing 30 changed files with 737 additions and 445 deletions.
22 changes: 22 additions & 0 deletions .github/CODEOWNERS
Validating CODEOWNERS rules …
Original file line number Diff line number Diff line change
@@ -0,0 +1,22 @@
# https://docs.github.com/en/repositories/managing-your-repositorys-settings-and-features/customizing-your-repository/about-code-owners

# Ending a path in a `/` will specify the code owners for every file
# nested in that directory, on any level

# Default owners
* @edgarrmondragon @cjohnhanson @aaronsteers

# CI/CD
/.github/workflows/ @edgarrmondragon @meltano/engineering

# Docs (General)
/docs/ @meltano/engineering @meltano/marketing
/README.md @afolson @tayloramurphy @meltano/engineering @meltano/marketing

# Docs (Contributing)
/docs/CONTRIBUTING.md @afolson @tayloramurphy @meltano/engineering

# Release Ops (see `/.pyproject.toml` for list of bumped files)
/cookiecutter/*/*/pyproject.toml @meltano/engineering
/docs/conf.py @meltano/engineering
/pyproject.toml @meltano/engineering
71 changes: 71 additions & 0 deletions .github/ISSUE_TEMPLATE/bug.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,71 @@
name: Bug Report
description: File a bug report
title: "[Bug]: <title>"
labels: ["kind/Bug", "valuestream/SDK"]
assignees:
- meltano/engineering

body:
- type: markdown
attributes:
value: |
Thanks for taking the time to fill out this bug report!
- type: input
id: sdk_version
attributes:
label: Singer SDK Version
description: Version of the library you are using
placeholder: "0.1.0"
validations:
required: true
- type: dropdown
id: python_version
attributes:
label: Python Version
description: Version of Python you are using
options:
- "3.6 (deprecated)"
- "3.7"
- "3.8"
- "3.9"
- "3.10"
- "NA"
validations:
required: true
- type: dropdown
id: scope
attributes:
label: Bug scope
description: Functionality this bug affects
options:
- Taps (catalog, state, stream maps, etc.)
- Targets (data type handling, batching, SQL object generation, etc.)
- Configuration (settings parsing, validation, etc.)
- CLI (options, error messages, logging, etc.)
- Other
validations:
required: true
- type: input
id: os
attributes:
label: Operating System
description: What operating system you are using
placeholder: "Windows"
validations:
required: true
- type: textarea
id: what-happened
attributes:
label: Description
description: Describe what you were trying to get done
placeholder: Tell us what happened, what went wrong, and what you expected to happen
validations:
required: true
- type: textarea
id: failing-code
attributes:
label: Code
description: Paste the failing code and/or traceback, if applicable
render: python
validations:
required: false
5 changes: 5 additions & 0 deletions .github/ISSUE_TEMPLATE/config.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,5 @@
blank_issues_enabled: true
contact_links:
- name: Meltano Community
url: https://meltano.com/slack
about: Join us on Slack.
32 changes: 32 additions & 0 deletions .github/ISSUE_TEMPLATE/feature.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,32 @@
name: Feature request
description: Request a new feature
title: "[Feature]: <title>"
labels: ["kind/Feature", "valuestream/SDK"]
assignees:
- meltano/engineering

body:
- type: markdown
attributes:
value: |
Thanks for taking the time to request a new feature!
- type: dropdown
id: scope
attributes:
label: Feature scope
description: Functionality this new feature would impact
options:
- Taps (catalog, state, stream maps, etc.)
- Targets (data type handling, batching, SQL object generation, etc.)
- Configuration (settings parsing, validation, etc.)
- CLI (options, error messages, logging, etc.)
- Other
validations:
required: true
- type: textarea
id: what
attributes:
label: Description
description: Describe the feature you would like to see
validations:
required: true
65 changes: 65 additions & 0 deletions .github/workflows/codeql-analysis.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,65 @@
# For most projects, this workflow file will not need changing; you simply need
# to commit it to your repository.
#
# You may wish to alter this file to override the set of languages analyzed,
# or to provide custom queries or build logic.
#
name: "CodeQL"

on:
push:
branches: [ "main" ]
pull_request: {}
schedule:
- cron: '37 10 * * 5'

jobs:
analyze:
name: Analyze
runs-on: ubuntu-latest
permissions:
actions: read
contents: read
security-events: write

strategy:
fail-fast: false
matrix:
language: [ 'python' ]
# CodeQL supports [ 'cpp', 'csharp', 'go', 'java', 'javascript', 'python', 'ruby' ]
# Learn more about CodeQL language support at https://aka.ms/codeql-docs/language-support

steps:
- name: Checkout repository
uses: actions/checkout@v3

# Initializes the CodeQL tools for scanning.
- name: Initialize CodeQL
uses: github/codeql-action/init@v2
with:
languages: ${{ matrix.language }}
# If you wish to specify custom queries, you can do so here or in a config file.
# By default, queries listed here will override any specified in a config file.
# Prefix the list here with "+" to use these queries and those in the config file.

# Details on CodeQL's query packs refer to : https://docs.github.com/en/code-security/code-scanning/automatically-scanning-your-code-for-vulnerabilities-and-errors/configuring-code-scanning#using-queries-in-ql-packs
# queries: security-extended,security-and-quality


# Autobuild attempts to build any compiled languages (C/C++, C#, or Java).
# If this step fails, then you should remove it and run the build manually (see below)
- name: Autobuild
uses: github/codeql-action/autobuild@v2

# ℹ️ Command-line programs to run using the OS shell.
# 📚 See https://docs.github.com/en/actions/using-workflows/workflow-syntax-for-github-actions#jobsjob_idstepsrun

# If the Autobuild fails above, remove it and uncomment the following three lines.
# modify them (or add more) to build your code if your project, please refer to the EXAMPLE below for guidance.

# - run: |
# echo "Run, Build Application using script"
# ./location_of_script_within_repo/buildscript.sh

- name: Perform CodeQL Analysis
uses: github/codeql-action/analyze@v2
9 changes: 4 additions & 5 deletions .github/workflows/constraints.txt
Original file line number Diff line number Diff line change
@@ -1,6 +1,5 @@
pip==22.1.2
poetry==1.1.13
virtualenv==20.15.1
changelog-cli==0.7.1
nox==2022.1.7
pip==22.2.2
poetry==1.1.14
virtualenv==20.16.3
nox==2022.8.7
nox-poetry==1.0.1
40 changes: 40 additions & 0 deletions .github/workflows/dependency-review.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,40 @@
name: Dependency Review

on:
pull_request_target: {}
workflow_dispatch:
inputs: {}

env:
FOSSA_CLI_INSTALLER_VERSION: '3.3.10'

permissions:
contents: read

jobs:
dependency-review:
runs-on: ubuntu-latest
steps:
- name: Checkout the repository
uses: actions/[email protected]

- name: GitHub dependency vulnerability check
if: ${{ github.event_name == 'pull_request_target' }}
# Use this fork until https://github.com/actions/dependency-review-action/pull/165 is merged
uses: WillDaSilva/dependency-review-action@main

- name: FOSSA dependency license check
run: |
# `$FOSSA_CLI_INSTALLER_VERSION` only controls the version of the installer used - the latest version of `fossa-cli` will always be used.
curl --no-progress-meter -H 'Cache-Control: no-cache' https://raw.githubusercontent.com/fossas/fossa-cli/v${FOSSA_CLI_INSTALLER_VERSION}/install-latest.sh | bash
echo '## FOSSA dependency license check' >> $GITHUB_STEP_SUMMARY
echo '' >> $GITHUB_STEP_SUMMARY
fossa analyze --fossa-api-key ${{ secrets.MELTYBOT_FOSSA_API_KEY }} --revision ${{ github.sha }} |& tee fossa_analyze.log
fossa test --fossa-api-key ${{ secrets.MELTYBOT_FOSSA_API_KEY }} --revision ${{ github.sha }}
TEST_FAILED=$?
FOSSA_REPORT_LINK="$(grep -A 1 '[ INFO] View FOSSA Report:' fossa_analyze.log | tail -n 1 | sed -e 's/^\[ INFO\]\s*//')"
echo "[FOSSA detected $([ $TEST_FAILED -ne 0 ] && echo -n '' || echo 'no ')issues](${FOSSA_REPORT_LINK})" >> $GITHUB_STEP_SUMMARY
exit $TEST_FAILED
4 changes: 2 additions & 2 deletions .github/workflows/release.yml
Original file line number Diff line number Diff line change
Expand Up @@ -14,7 +14,7 @@ jobs:
uses: actions/[email protected]

- name: Set up Python
uses: actions/setup-python@v4.0.0
uses: actions/setup-python@v4.2.0
with:
python-version: "3.10"

Expand Down Expand Up @@ -47,7 +47,7 @@ jobs:
file_glob: true

- name: Publish
uses: pypa/[email protected].0
uses: pypa/[email protected].1
with:
user: __token__
password: ${{ secrets.PYPI_SECRET_TOKEN }}
14 changes: 11 additions & 3 deletions .github/workflows/test.yml
Original file line number Diff line number Diff line change
Expand Up @@ -25,6 +25,14 @@ jobs:
- { session: tests, python-version: "3.8", os: "ubuntu-latest" }
- { session: tests, python-version: "3.9", os: "ubuntu-latest" }
- { session: tests, python-version: "3.10", os: "ubuntu-latest" }
- { session: tests, python-version: "3.7", os: "macos-latest" }
- { session: tests, python-version: "3.8", os: "macos-latest" }
- { session: tests, python-version: "3.9", os: "macos-latest" }
- { session: tests, python-version: "3.10", os: "macos-latest" }
- { session: tests, python-version: "3.7", os: "windows-latest" }
- { session: tests, python-version: "3.8", os: "windows-latest" }
- { session: tests, python-version: "3.9", os: "windows-latest" }
- { session: tests, python-version: "3.10", os: "windows-latest" }
- { session: doctest, python-version: "3.10", os: "ubuntu-latest" }
- { session: mypy, python-version: "3.8", os: "ubuntu-latest" }

Expand All @@ -40,7 +48,7 @@ jobs:
poetry --version
- name: Setup Python ${{ matrix.python-version }}
uses: actions/setup-python@v4.0.0
uses: actions/setup-python@v4.2.0
with:
python-version: ${{ matrix.python-version }}
architecture: x64
Expand Down Expand Up @@ -98,7 +106,7 @@ jobs:
poetry --version
- name: Setup Python 3.10
uses: actions/setup-python@v4.0.0
uses: actions/setup-python@v4.2.0
with:
python-version: '3.10'
architecture: x64
Expand Down Expand Up @@ -138,7 +146,7 @@ jobs:
poetry --version
- name: Set up Python
uses: actions/setup-python@v4.0.0
uses: actions/setup-python@v4.2.0
with:
python-version: '3.10'
cache: 'pip'
Expand Down
11 changes: 5 additions & 6 deletions .github/workflows/version_bump.yml
Original file line number Diff line number Diff line change
Expand Up @@ -10,9 +10,9 @@ on:
default: auto
options:
- auto
- PATCH
- MINOR
- MAJOR
- patch
- minor
- major
prerelease:
description: "Increase to this prerelease version"
required: false
Expand Down Expand Up @@ -40,15 +40,14 @@ jobs:
fetch-depth: 0

- name: Set up Python
uses: actions/setup-python@v4.0.0
uses: actions/setup-python@v4.2.0
with:
python-version: "3.10"
architecture: x64

- name: Bump version
id: cz-bump
# TODO: https://github.com/commitizen-tools/commitizen-action/pull/38
uses: edgarrmondragon/commitizen-action@feat-add-increment-option
uses: commitizen-tools/[email protected]
with:
increment: ${{ github.event.inputs.bump != 'auto' && github.event.inputs.bump || '' }}
prerelease: ${{ github.event.inputs.prerelease != 'none' && github.event.inputs.prerelease || '' }}
Expand Down
20 changes: 0 additions & 20 deletions .gitlab/CODEOWNERS

This file was deleted.

27 changes: 0 additions & 27 deletions .gitlab/issue_templates/Bug.md

This file was deleted.

Loading

0 comments on commit 07464d7

Please sign in to comment.