Skip to content

A k8s based unified development environment for Cosmos Ecosystem (and beyond)

License

Notifications You must be signed in to change notification settings

persistenceOne/starship

 
 

Repository files navigation

Starship

Universal interchain development environment in k8s. The vision of this project is to have a single easy to use developer environment with full testing support for multichain use cases

Installation

In order to get started with starship, one needs to install the following

Getting started

Follow the steps here: https://starship.cosmology.tech

Using helm chart

Inorder to use the helm chart externally without this repo.

helm repo add starship https://cosmology-tech.github.io/starship
helm repo update

helm search repo starship/devnet

Fetch the values.yaml file and update them before installing the chart

helm show values starship/devnet > custom-vaules.yaml
# change custom-values.yaml file

helm install -f custom-values.yaml starship/devnet --generate-name

NOTE: It is recommended to still copy the Makefile from the repo to use the handy commands

Future works

Some features that are to be added

  • Default values for each chain, addition of type for chains
  • Move scripts directly to configmaps
  • Add support for hermes and go relayers
  • How to perform ingress for local or cluster to get traffic to the system, this will remove the need for any sort of local port forwarding

Improvements

  • Make faster kye initialization, currently most time at startup is taken by adding keys to keyring from mnemonics
  • Add comments to values.yaml
  • Currently, the setup runs well for 12hrs before hitting the memory limits and the storage limits. Need to set proper pruning setup for optimal devnet

Major design considerations

GH Actions

Run this in CI/CD.

E2E tests

The actual tests we can run.

Docker images

Currently, for each chain, the docker image needs to be built stored in docker/ directory. Most of the docker images just need jq, bash and sed. Can look into using strangelove-ventures/heighliner for docker images creation instead of having self-hosted

Chain binary

The docker images also require the chain binary to be already part of the container. Need the ability for users to either pass the binary as input, or to build binary on the fly, so that we can use a standard base docker image, and add binaries on top.

Mainnet exports

Ability to get an exported state on a mainnet/testnet for a chain, and update locally. LocalOsmosis has some functions and scripts to perform the state change.

Ideally we will spin up a new type of container, fetch the data, perform transformations and spread it out to all the following validator nodes.

Upgrade testing: ToDo

  • Run chain in current state, need to install cosmovisor on all nodes
    • Might neeed to binary pre-installed for both upgrades
    • Can fetch binary via a wget in init-containers
    • Can build the code in init container as well
  • run some pre-upgrade txns state
  • create upgrade proposal
  • cosmovisor will do the upgrade automatically
  • After upgrade, we loose the touch with ability to update genesis.json directly,

Bazel: Servicify

  • Serviceify this, blaze tests, run all the test for any language
    • Bazal integrates with remote test runner
  • Service running that listens to commands, and run commands on the cluster
    • Test RPC: takes test request and spits out an output
    • Create a web frontend that displays your results
  • If we provide any sort of devnet service, we need to figure out Authn for all the calls, knowing that for local debugging there is no authn for actual blockchains. Port-forwarding does not sound like a bad idea, since the burden of authn is on kubectl.

Stress testing and profiling

Inorder to understand the topology and deeper insights into how the system works, it would make sense to try and use a simulated environment and perform stress tests as a blackbox testing. We can create new binaries with pprof or profiling tool embedded, run test workflow and look at the analytics.

Currently, the way to do this, is very manual and some tools are being built for local profiling, but large scale profiling still needs to happen.

About

A k8s based unified development environment for Cosmos Ecosystem (and beyond)

Resources

License

Stars

Watchers

Forks

Packages

No packages published

Languages

  • Starlark 60.1%
  • Go 27.5%
  • Shell 7.5%
  • Makefile 2.2%
  • Smarty 1.4%
  • Dockerfile 1.3%