ADR-038 go-plugin system

[egaxhaj]

For #10096

replaces #11691

This is an extension and refactor of the existing ADR-038 streaming service work to introduce a plugin system over gRPC to the SDK and load streaming services using the hashicorp/go-plugin system rather the approach taken in #11691 (which uses Go's built in Plugins API).

The plugin system introduced here is meant to be extensible, so that if other components/features of the SDK wish to be included as plugins in the future they can write plugins with minimal effort by defining an interface and a gRPC message protocol and leveraging the built in plugin system.

---

Author Checklist

All items are required. Please add a note to the item if the item is not applicable and
please add links to any relevant follow up issues.

I have...

• included the correct type prefix in the PR title
• added ! to the type prefix if API or client breaking change
• targeted the correct branch (see PR Targeting)
• provided a link to the relevant issue or specification
• followed the guidelines for building modules
• included the necessary unit and integration tests
• added a changelog entry to CHANGELOG.md
• included comments for documenting Go code
• updated the relevant documentation or specification
• reviewed "Files changed" and left comments if necessary
• confirmed all CI checks have passed

Reviewers Checklist

All items are required. Please add a note if the item is not applicable and please add
your handle next to the items reviewed if you only reviewed selected items.

I have...

• confirmed the correct type prefix in the PR title
• confirmed ! in the type prefix if API or client breaking change
• confirmed all author checklist items have been addressed
• reviewed state machine logic
• reviewed API design and naming
• reviewed documentation is accurate
• reviewed tests and test coverage
• manually tested (if applicable)

[yihuang]

The in-process streaming service is still supported by calling SetStreamingService directly, right?

[egaxhaj]

The in-process streaming service is still supported by calling SetStreamingService directly, right?

Yes.

cosmos-sdk/baseapp/streaming.go

Lines 104 to 108 in 9ccf4fe

	bApp.SetStreamingService(StreamingService{
	Listeners: listeners,
	ABCIListener: abciListener,
	StopNodeOnErr: stopNodeOnErr,
	})

[alexanderbez]

Awesome! Looking forward to reviewing this!

[alexanderbez]

I'd like to have this blocked until #13473 gets sufficiently reviewed and approved 👍

[egaxhaj]

I'd like to have this blocked until #13473 gets sufficiently reviewed and approved 👍

[egaxhaj]

My apologies. I accidentally closed this while trying to comment.

[tac0turtle]

Overall love the improvements. Thinking out loud: should we remove the file service already present in the repo? Can be in a subsequent pr.

[yihuang]

It don't support registering multiple StreamingServices with this implementation?

[egaxhaj]

I am closing this as the work in this PR is stale. Work has moved to #14207.