Magda Format Minion

A Magda minion is a service that listens for new records or changes to existing records, performs some kind of operation and then writes the result back to the registry. For instance, we have a broken link minion that listens for changes to distributions, retrieves the URLs described, records whether they were able to be accessed successfully and then writes that back to the registry in its own aspect.

Other aspects exist that are written to by many minions - for instance, we have a "quality" aspect that contains a number of different quality ratings from different sources, which are averaged out and used by search.

This magda minion can generate more accurate distribution format information.

Release Registry

Since v2.0.0, we use Github Container Registry as our official Helm Chart & Docker Image release registry.

It's recommended to deploy minions with as dependencies of a Magda helm deployment.

dependencies:
  - name: magda-minion-format
    version: "2.0.0"
    repository: "oci://ghcr.io/magda-io/charts"

Requirements

Kubernetes: >= 1.14.0-0

Repository	Name	Version
oci://ghcr.io/magda-io/charts	magda-common	2.1.1

Values

Key	Type	Default	Description
crawlerRecordFetchNumber	int	50	During the proactive crawling process, how many events are processed in one batch. You can increase this number when you have more resource to speed up the crawling process
defaultAdminUserId	string	"00000000-0000-4000-8000-000000000000"
defaultImage.imagePullSecret	bool	false
defaultImage.pullPolicy	string	"IfNotPresent"
defaultImage.repository	string	"ghcr.io/magda-io"
global.image	object	{}
global.minions.image	object	{}
global.rollingUpdate	object	{}
image.name	string	"magda-minion-format"
resources.limits.cpu	string	"100m"
resources.requests.cpu	string	"10m"
resources.requests.memory	string	"50Mi"