Skip to content

Commit

Permalink
Merge branch 'main' into dev
Browse files Browse the repository at this point in the history
  • Loading branch information
ReubenFrankel committed Feb 15, 2023
2 parents dc91ac6 + 6bc9ed3 commit 2588ab8
Show file tree
Hide file tree
Showing 5 changed files with 79 additions and 86 deletions.
3 changes: 3 additions & 0 deletions .gitignore
Original file line number Diff line number Diff line change
@@ -0,0 +1,3 @@
workspaces/*

!.gitkeep
57 changes: 57 additions & 0 deletions plugins/extractors/tap-auth0--matatika.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,57 @@
name: tap-auth0
namespace: tap_auth0
label: Auth0
logo_url: /assets/images/datasource/tap-auth0.png
description: |-
Auth0 is an identity and access management service, that allows you to manage the access of your users.
## Prerequisites
To find out how to get the required credentials for this data source please go to our documentation: [Auth0 Prerequisites](${docsBaseUrl}/data-sources/tap-auth0/prerequisites)
## Data source settings
### Client ID
Your Auth0 Machine-to-Machine application client id.
### Client Secret
Your Auth0 Machine-to-Machine application client secret.
### Domain
Your Auth0 tenant domain in the format `<TENANT_NAME>.<REGION_IDENTIFIER>.auth0.com``
## Learn more
[Matatika Auth0 Data Source Documentation](${docsBaseUrl}/data-sources/tap-auth0)
[Meltano Hub Auth0 Documentation](https://hub.meltano.com/taps/auth0)
variant: matatika
docs: ${docsBaseUrl}/data-sources/tap-auth0/
repo: https://github.com/Matatika/tap-auth0
pip_url: git+https://github.com/Matatika/[email protected]
capabilities:
- catalog
- discover
- state
settings:
- name: client_id
label: Client ID
kind: password
required: true
- name: client_secret
label: Client Secret
kind: password
required: true
- name: domain
label: Domain
required: true
- name: job_poll_interval_ms
kind: hidden
value: 2000
- name: job_poll_max_count
kind: hidden
value: 10
91 changes: 5 additions & 86 deletions plugins/extractors/tap-github--meltanolabs.yml
Original file line number Diff line number Diff line change
Expand Up @@ -7,76 +7,26 @@ description: |-
## Prerequisites
You will need a Github `auth_token` scoped with everything you need access to. For help with this you can follow the Github [Creating a Personal Access Token Docs](https://docs.github.com/en/authentication/keeping-your-account-and-data-secure/creating-a-personal-access-token)
You will also need to provide one of the following settings:
- `Repositories`
- `Organizations`
- `Searches`
- `User Usernames`
- `User IDs`
You will need a Github `auth_token` scoped with full access to repo. For help with this you can follow the GitHub [Creating a Personal Access Token Docs](https://docs.github.com/en/authentication/keeping-your-account-and-data-secure/creating-a-personal-access-token)
## Auth Token
Github token to authenticate with.
## Additional Auth Tokens
List of GitHub tokens to authenticate with. Streams will loop through them when hitting rate limits.
## Rate Limit Buffer
Add a buffer to avoid consuming all query points for the token at hand.
## Searches
An array of search descriptor objects with the following properties. "name" - a human readable name for the search query. "query" - a github search string (generally the same as would come after ?q= in the URL).
## Organizations
An array of strings containing the github organizations to be included.
Example: `["Matatika", "MatatikaBytes"]`
## Repositories
An array of strings containing the github repos to be included.
Example: `["Matatika/tap-spotify", "Matatika/tap-auth0"]`
## User Usernames
An array of strings containing GitHub usernames.
Example: `["user", "usertwo"]`
## User IDs
A list of GitHub user ids.
Example: `["12345", "54321"]`
## Start Date
When to start syncing data from.
## Stream Maps
Optional stream maps.
## Stream Map Config
Configuration for your stream maps.
## Skip Parent Streams
Set to true to skip API calls for the parent streams (such as repositories) if it is not selected but children are.
Example: `["Matatika/matatika-ce"]`
## Learn more
[Matatika Github Data Source Documentation](${docsBaseUrl}/data-sources/tap-github)
[Matatika GitHub Data Source Documentation](${docsBaseUrl}/data-sources/tap-github)
[Meltano Hub Auth0 Documentation](https://hub.meltano.com/extractors/tap-github/)
[Meltano Hub GitHub Documentation](https://hub.meltano.com/extractors/tap-github/)
variant: meltanolabs
docs: ${docsBaseUrl}/data-sources/tap-github/
Expand All @@ -88,45 +38,14 @@ capabilities:
- discover
- about
settings:
- label: User Agent
name: user_agent
- description: The log level of the API response metrics.
label: Metrics Log Level
name: metrics_log_level
- kind: password
label: Auth Token
name: auth_token
required: true
- kind: array
label: Additional Auth Tokens
name: additional_auth_tokens
- kind: integer
label: Rate Limit Buffer
name: rate_limit_buffer
- kind: array
label: Searches
name: searches
- kind: array
label: Organizations
name: organizations
- kind: array
label: Repositories
name: repositories
- kind: array
label: User Usernames
name: user_usernames
- kind: array
label: User IDs
name: user_ids
- kind: date_iso8601
label: Start Date
name: start_date
- kind: object
label: Stream Maps
name: stream_maps
- kind: object
label: Stream Map Config
name: stream_map_config
- kind: boolean
label: Skip Parent Streams
name: skip_parent_streams
required: true
14 changes: 14 additions & 0 deletions plugins/files/analyze-auth0--matatika.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,14 @@
name: analyze-auth0
namespace: tap_auth0
label: Auth0 Insights
description: |-
Instant insights on users, logins and quotas from Auth0.
update:
'*.yml': true
variant: matatika
repo: https://github.com/Matatika/analyze-auth0
pip_url: git+https://github.com/Matatika/[email protected]
requires:
extractors:
- name: tap-auth0
variant: matatika
File renamed without changes.

0 comments on commit 2588ab8

Please sign in to comment.