CBG-3764 update base implementation of XDCR in rosmar #6746

* Refactor makeHandler functions to use handlerOptions * Add /_ping API endpoint and silent handler functionality * Add API docs for /_ping * Publicly accessible and declare on metric router * Add test * Skip writing response body when request method is HEAD (RFC-9110) * Only honor handler's requested log level if the request was successful

* Add TestRevocationsWithQueryLimit2Channels and fix loop * Move lastSeq assignment before inner loop

* Avoid a data race on writing db.PurgeInterval during test allow specifying PurgeInterval in DatabaseContextOptions to override the value we might return from the server.

err was shadowed inside a goroutine, added scoping when available

* Silence metrics requests * Lower log level of successful admin auth and 'Recording snapshot of current debug variables' message

Co-authored-by: adamcfraser <[email protected]>

* Pass context into Query * Pass context into changes/channel cache * Fix missing ctx param in test ExplainQuery * Remove loggingCtx to force caller to pass a context and add context for test functions * Only Flush on gocb buckets --------- Co-authored-by: Tor Colvin <[email protected]>

Restores the 3.0.x read buffer size, to avoid memory growth in 3.1.1 associated with cbgt/import.

* Make SubdocXattrStore work with Rosmar collections * There's a new interface sgbucket.XattrStore2 that contains the methods of SubdocXattrStore that aren't redundant. * rosmar.Collection implements XattrStore2. * LeakyDataStore now implements SubdocXattrStore; the methods are either delegated to their existing DataStore counterparts, or to the new methods from XattrStore2. * AsSubdocXattrStore() isn't needed anymore, because LeakyDataStore now implements SubdocXattrStore. * Removed obsolete TestRequiresSubdocXattrStore()

Co-authored-by: Ben Brooks <[email protected]>

* CBG-3352 remove invalidation, just remove data from cache * Fix fieldalignment on structs

- drop a lock by not checking the value before we remove it from the cache. - switched name from Invalidate to Remove for clarity

* CBG-3292: force config update on corrupt db config

…achment (#6414)

* Update XattrStore, remove subdocXattrStore Remove subdocXattrStore (previously used to support working with multiple gocb versions), moving required functions not already included in XattrStore into XattrStore.

Co-authored-by: Ben Brooks <[email protected]>

* CBG-3277 add a stat for mismatched bucket names in dbconfigs * fix panic if bootstrap polling removes a database in memory while a REST API call is happening

…6420)

* Bump all other (non /x/crypto) dependencies to latest versions * Roll back keep otto at the old version

…6430) * CBG-3385: link up the reset resync code to the api for a user to use * changes to open api docs to reflect change * fix type error on open api docs

…6432)

* Reenable TestMultiCollectionDCP and fix

…sg-bucket (#6422) * ctx * Update with sg-bucket changes * Add dcp * update go.mod * Use context that doesn't go out of scope * fix ctx * go mod tidy * amend comment * Use correct ctx * update rosmar and sg-bucket * simplify context in dcp feed * Update rosmar go.mod

)

Co-authored-by: Ben Brooks <[email protected]>

… sequence at the cache causing changes feed to not pick the update up. Changed the changes call to use request plus and also disable sequence batching to allow asertions on sequences to hold true (#6443)

* Rebase on master * go.mod bump for merged dependencies * CBG-3291 Define macro expansion in MutateInOpts Uptake sg-bucket changes to pass macro expansions for a given operation to the XattrStore implementation (*Collection), instead of hardcoding in the low-level subdoc operations. The macro expansion options are set in three places for non-test code: - updateAndReturnDoc, handles standard writes/imports via WriteUpdateWithXattr - migrateMetadata, performs migration via WriteWithXattr - resyncDocument, uses WriteUpdateWithXattr (different retry than updateAndReturnDoc) Prerequisite for the expanded use of macro expansion for HLV properties. Also includes some cleanup of the XattrStore interface to remove internal-only operations. * Integration test fixes * Fix attachment test * PR suggestions/fixes * Update dependencies

* CBG-3238 perform a length check on raw bytes - refactor attachment compaction tests so we can make sure that it doesn't terminate * Add comment * remove redundant returns * Move error handling into getAttachmentSyncData * PR fixup - remove attachment compaction changes and leave only a change to avoid failure to mark changes if xattr length is invalid. Treat this as a document without xattrs in order to not fail attachment compaction test. - add code to prevent overflow if xattr len is a number between 1-4 which would cause a panic. * Update tests * remove test tested in separate function

* Add dependabot module updates Using this as a mechanism to at least give us notifications and streamline module updates. Dependabot will open a PR for any upstream module updates. We can choose whether to merge them or close them. * Add license

…6445) * CBG-3394 don't panic if user is deleted with active blip replication * Return 503 on user reload failures

The previous changes to changeCache.updateStats() guard against an nil db inside that call, but don't cover nil channelCache. We shouldn't hit the nil db and DbStats cases, but added these for additional protection in case of unexpected interactions with sc.logStats.

* CBG-2579: update to actually reduce the checkpoint interval. Comment suggested disabling the checkpoint interval which is not what the test is doing * updates to increase checkpoint interval * temp enable trace loging * updates to add trace logging to enable us to debug further * fix comment

* CBG-3399: bump up import partitions on rest tester as just having 1 killed the import feed when having multiple nodes sometimes

…6472) * Database console log setting takes precedence over console log setting, if set... * Reword deprecated logging endpoint warning log * Fix G601: Implicit memory aliasing in for loop. (gosec) * Add test to cover combining console and db log config for shouldLog

) * CBG-3395: pick up gocbcore patch for boostrap against non KV node * uptake new gocb release too * go mod tidy

* CBG-3449 Ensure metadata persistence on rollback Adds a mustPersist option to setMeta to ensure persistence during rollback. setMeta also returns error if checkpoint persistence fails (e.g. transient server error). This error is ignored during normal checkpointing, but is returned by the Rollback/RollbackEx implementations.

…6473)

) * CBG-3461 Delete legacy config when migrated config already exists In the case where a 3.1 version of the config exists, delete duplicate 3.0 config if found with matching database and config group.

…nfigs (#6479)

…ts `%w` (#6494)

* Add unsupported.disallow_dbconfig_env_vars to opt out of db config env var expansion * Add test for DisallowDbConfigEnvVars coverage * Flip bool (default to true)

…egistry (#6486) * CBG-3445 stamp db version into gateway registry - update gateway registry on startup to include new version numbers - ensure that a database is not loaded if is more than a minor version upgrade Improvements to ComparableVersion - make copyable so that you can't pass a nil version by mistake - change String() method to be a non pointer method to avoid mishaps if you don't print a pointer.

…6508)

…ges to delete handling (#6513) * CBG-3646 Update TestMigratev30PersistentConfigCollision based on changes to delete handling migrateV30Configs no longer terminates and returns error on migrate failure for a single bucket - it instead logs the error and continues through the rest of the bucket. * Avoid race in TestCorruptDbConfigHandling

…gedLogging (#6517) * Fix race in AssertLogContains by forcing console log buffer flush before checking contents - avoids multiple buffer reads during log writes * Fix TestDocChangedLogging test race

* CBG-3518 flush the log buffers collateBuffer is enabled * Remove warning count assertion since warnings can come through from DCP mutations from previous tests * Update the assertion to use testify contains

* CBG-3522 add collection to import feed logic * Use a ptr, update documentation, fix return value

)

…t collection (#6504) * CBG-3384 Modify computation of metadataID - Don’t persist syncInfo for empty metadataID (legacy config) - Modify requirements for assignment of default metadata ID to a database: 1. Remove requirement for presence of _sync:seq in default collection 2. Allow assignment when default collection’s syncInfo is using defaultMetadataID These avoid triggering resync for databases using only the default collection, in legacy and non-legacy mode. If database already exists in registry, new databases (in different config groups) should use the same metadataID.

* CBG-3533 remove implicit default of http console logging * Turn back on HTTP logging for tests Allows not streaming any logs (including HTTP logs) on capella.

* CBG-3498 create function NewRestTesterPersistentConfig NewRestTesterPersistentConfig will create a RestTester with peristent config and start up a database. This differs from setting RestTesterConfig{Persistent: true} in that the database is created for you. I didn't allow passing configuration options, since I am not sure all of them work with Persistent: true. Migrate many uses of creating ServerContext directly to RestTester which makes the tests collection-aware and often runnable under rosmar.

…#6535) * Create type DocVersion which will allow using HLV or RevID * Create helper functions to use with DocVersion instead of RevIDs

* CBG-3553 add bucket.Close() when opening the database - close the DatabaseContext if it's not managed by the database if it hasn't been added to - changed newSequenceAllocator to not leak a goroutine * Don't create db automatically * Improve error message * Don't close dbcontext if already registered * Remove test which did not test anything

…seq traffic (#6547) Co-authored-by: Ben Brooks <[email protected]>

* CBG-3268 modify attachment_test.go to remove rev * Restore interface as PushVersion * Add missing wg.Add

* Enable unconvert * Enable unused code check

…changes feed filtered to a channel (#6551) * CBG-3559: ensure we check inherited channels across assigned roles when filtering the changes feed to availible channels to the user * chnage implementation, add userImpl canSeeCollectionChannelSince * remove unused function

- move specific tests in import_test.go to xattr_upgrade_test.go since they are specifically needed only when doing a rolling upgrade from inline -> xattr metadata

…ces (#6555) - update go.mod and ci to make sure that go-1.21.3 is used

* CBG-3268 replace WaitForRev with WaitForVersion

* CBG-3268 remove RespRevID and prepare for HLV aware testing

* CBG-3577 Uptake cbgt fix for MB-59249 Includes new unit test that reproduced the issue being fixed. * PR review fixes

* CBG-3210: Updating HLV on Put And PutExistingRev (#6366) * CBG-3209: Add cv index and retrieval for revision cache (#6491) * CBG-3209: changes for retreival of a doc from the rev cache via CV with backwards compatability in mind * fix failing test, add commnets * fix lint * updated to address comments * rebase chnages needed * updated to tests that call Get on revision cache * updates based of new direction with PR + addressing comments * updated to fix panic * updated to fix another panic * address comments * updates based off commnets * remove commnented out line * updates to skip test relying on import and update PutExistingRev doc update type to update HLV * updates to remove code adding rev id to value inside addToRevMapPostLoad. Added code to assign this inside value.store * remove redundent code * CBG-3210: Updating HLV on Put And PutExistingRev (#6366) * CBG-3209: Add cv index and retrieval for revision cache (#6491) * CBG-3209: changes for retreival of a doc from the rev cache via CV with backwards compatability in mind * fix failing test, add commnets * fix lint * updated to address comments * rebase chnages needed * updated to tests that call Get on revision cache * updates based of new direction with PR + addressing comments * updated to fix panic * updated to fix another panic * address comments * updates based off commnets * remove commnented out line * updates to skip test relying on import and update PutExistingRev doc update type to update HLV * updates to remove code adding rev id to value inside addToRevMapPostLoad. Added code to assign this inside value.store * remove redundent code * CBG-3576: changes to BlipTesterClient to run with version vector subprotocol and non version vector subprotocol * updates to work with rebase changes * changes to remove repeated code, assuming from the rebase? * refactoring based off discussion with Ben * lint error fix

…6567)" (#6573) This reverts commit a398881.

This means it is automatically picked up by editors in addition to CI. Usually this is fast, but sometimes staticcheck can slow down, especially on mac. Once it is cached, it is quick. Updated golangci-lint version in github actions.

…ocol versions (#6574)

* CBG-3271 remove persistent rosmar buckets - rosmar now supports persisting in memory buckets, so keep the buckets in memory until the buckets are closed. This eliminates NoCloseClone in many cases. Another PR might be able to remove even more of these. - this is prep for being able to run a bootstrap connection.

…or `<=` and `>=` comparisons (#6582) * wip * Use updated go-blip server.WaitUntilStarted to log ws upgrade * Fix subprotocol comparison operators * Set active subprotocol version for SG-side BlipSyncContext (received blipsync requests) * Strip out CBMobile_4 subversion until VV changes are ready * addlicense * Remove unnessesary middleware function for BLIPSync * Switch to server.PostHandshakeCallback to avoid data race between blip handler and ws handshake * bump go-blip to PR commit hash * Bump go-blip for merged PR

* Add CBMobileReplicationV4 const * Ensure TestAllowedAttachments works with v4 replicator version

* CBG-3615 Escape sequence keyword, pass tests with 7.6 - for integration tests, allow non dockerhub images if you specify a path * use wildcard rather than regex

…handling (#6587) handling

…6588) * Fully escape JSON strings when using InjectJSONProperties * Fall through to `default` case for strings, but leave warning comment to make it clear it was an intentional decision to fall through for strings.

…one CAS handling (#6587)" (#6591) This reverts commit 5c90fa7.

#6592)

* Make sure GetDatabase always refers to 1 database * Avoid using GetDatabase ambiguously

- implement and start a BootstrapConnection in RestTester - create a new bucket object each time since it's a cheap copy option in rosmar some test fixup: - use NewDbConfig for rosmar config, which uses a peculiar combination of views and collections, normally disallowed - make some config polling faster to speed up testing - change some error reporting to use testify to report trace - fix UpdateConfig uses to set cfgCas to the previous cas value so the tests pass again against CBS Continue to skip some tests under rosmar: * Skip serverless tests that explicitly require bucket specific credentials * Mark tests that will race in creating http servers to be fixed in a future ticket

* CBG-3616 add node cpu stat

…nction (#6597) * CBG-3612 allow modifying exp in Collection.UpdatepBodyAndXattr * make sure that import will preserve expiry, and a sync function can reset the TTL * Update rosmar to enable BucketStoreFeaturePreserveExpiry * Add guardrails to make sure we can not produce programmer error about PreserveExpiry * Make sure that expiry is passed as nil ptr for purposes of knowing whether to update

* Create release/3.1.3

Co-authored-by: Ben Brooks <[email protected]>

* CBG-3652 check Origin header on websocket

…ilure to start (#6611) * CBG-3642 make sure channelCache is closed correctly in case of DCP failure - If the mutation feed fails to start, the channelCache would be set to nil. Previously, this actually would leak background processes, so stop before setting to nil. - Set channelCache to nil, because the terminator is not initialized unless changeCache is initialized. Added validation for finding the collectionIDs in the manifest to cause StartDCPFeed to fail in the case of gocb (this already failed in rosmar).

* CBG-3513: flaky test fix for TestCorruptDbConfigHandling

…#6615)

Fixes CVE-2023-48795 which does not affect SG since it requires ssh library.

* Add lock around logging due to potential Start/Stop race condition * Drop logging to avoid data race

Brings in change to sort metrics_metadata.json content.

- resync tests asserted that they were running a specific instance of db.ResyncManager or db.ResyncManagerDCP. This is controlled by an unsupported database setting, so set the database setting where required, and delete the tests that have duplicate coverage.

* Show documents that might be around after N1QL emptying fails, useful for debugging test failures

…T/upsert (#6627) * Allow user_xattr_key to be removed with an empty-string POST/upsert * Move user xattr tests into their own package and organise by functionality * Add new TestUserXattrSetUnsetDBConfig test for empty string POST/Upsert and nil on PUT * Run addlicense * Force new test to run with persistent config * Address PR comments

…back to GitHub PRs) (#6629)

…ffing (#6630)

Setting http.DefaultClient.Jar would cause anything that ran after it to authenticate with this session token. In practice, this happens for blip tests becuase they use guest access and the flow is: - check basic auth - check session - check guest access To be safe, I switched places that use http.DefaultClient as a global in anything other than read-only to use http.Client{} explicitly.

* CBG-3638 make BootstrapStartupConfigForTest parallel Previous to this commit, tests that used BootstrapStartupConfigForTest would start a real web server that listened on fixed ports: 14984, 14985, 14986. This worked fine for integration test runs with Couchbase Server, since they have to be run with `go test -p 1` because of limitations of the amount of churning the bucket pool does. This limitation does not apply to rosmar. If two packages were running tests simultaneously, this would error. BootstrapStartupConfigForTest now creates servers on :0, and there is a test API for looking up the address of the listener. Allow BootstrapStartupConfigForTest to work for CE edition without GroupID when it is not necessary, so the tests work on github. In the case of a bucket pool backed by CBS, these require a unique groupID since even a tombstoned config will be read. In rosmar, the buckets are dropped between each test so this isn't a concern. The motivation for this is to run more tests in GH actions. * Have test use bootstrap server methods

This causes a race condition in the instance that two databases with the same config group are created simultaneously. An example of how this can happen is: - config polling to pick up a db config A - GET /dbA/ The second will independently attempt to load the configuration while the first is running. In theory, this could happen for any different database in step 2, since all databases will be in the same group id.

- each ServerContext will reset the global logger. Only reset the global logging once per execution of the program, to simulate what happens in mane. - dbReplicatorStats map can be accessed simultaneously by SGReplicateMgr and when it is explicitly called in the test. - Mutex RegisterImportPindexImpl which was unsynchronized when multiple calls to NewDatabaseContext happen simultaneously.

…etchAndLoadDatabase (#6638)

* write test * Change validation * CBG-3697 make sure on demand import errors show up as 404 - The result of this is that blip will send a NoRev message since this revision is not accessible. - Delete validation in validateImportBody rather than change the type to report 404 since the only caller does not pass a nil pointer into this function.

…6641)

- Create a basic Replication interface to be matched in rosmar

…` or `%v`) (#6636) * Add ruleguard rule for Sync Gateway logging format containing Go error wrapping verb (%w) * nolint:unused in ruleguard file * simplify rule (ignore error type - add test file) * nolint test files * run ruleguard * Re-enable all gocritic linters in non-strict lint config * Remove old comment and add testing.T methods * Test testing.T * Add tests for Fatalf/Errorf/Skipf

* Shuffle tests * Make TestSetRedaction clean up after itself * Drop shuffled runs on integration tests

* lint: gocritic: Enable ruleguard (have to explicitly define default enabled rules) * Fix unused queryCloseErr * Fix unused meta var in TestIndexMeta * Re-enable tests for CBG-755 / MB-37622

* CBG-3686 add idle kv ops stat * Move stats to after read/write operation. Remove unused stat for CfgSG. Add docs

* implement body.Close * Add some missing asserts, simplify MakeUser * add missing error check

* Run go.mod tidy * Add tools file to prevent go-ruleguard from being declared an indirect depenency

* CBG-3724 ensure import rollback works correctly Major fix: pass a function to call cbgt.JANITOR_ROLLBACK_PINDEX when creating a pindex. This is necessary to ensure cbgt.Mgr will actually generate the index. - fix the TestImportRollback test which was giving a false pass before because the cbgt.Mgr was getting a kick op when the nodes were rebalanced. In order for rollback to work, the cbgt.Dest RollbackEx function has to force cgbt.Mgr to actually update the PIndex. A cbgt.JANITOR_ROLLBACK_PINDEX op will force the recreation of a PIndex. This test was broken before adding code to it. - Enhance the TestImportRollback to detect a rollback with invalid FailoverLogs. This simulates a situation where the checkpoints have been migrated from a separate bucket. - modify TestContinuousRollback to also test with bad vbuuid FailoverEntry. This test actually would pass, because Sync Gateway, unlike cbgt, did not pass DcpStreamAddFlagStrictVBUUID. DcpStreamAddFlagStrictVBUUID forces a rollback in the case where StartSeqNo=0 vbuuid=invalid whereas without the flag it is treated like StartSeqNo=0 vbuuid=0. Changed the code to match cbgt behavior adding DcpStreamAddFlagStrictVBUUID. - Added a separate flag in DCPClient to detect active vBuckets, which are the number of vBuckets that actually have a connection, and are not stuck in a connecting state. This differs from the existing activeVbuckets which is set from the time of NewDCPClient to when the streams end. In a continuous feed, the streams should never end. Cleanup: - move RollbackEx function from DCPDest to DCPCommon. DCPCommon is an embedded struct in DCPDest. - panic if DCPCommon.Rollback is called. This should never happen given the design of cbgt.Dest, but if it did, the rollback would not work. This is different from the old behavior where it would not rollback and potentially enter a rollback loop if this function was called. - remove maxVbNo from NewDCPDest in effort to shorten the arguments since the flag can be inferred from base.Bucket. - Create some public structs to make tests easier: - ShardedImportDCPMetadata - CBGCfgIndexDefs, CBGTIndexNodeDefsKnown, CBGTIndexNodeDefsWanted, CBGTCfgPlanPIndexes * work around MB-60564 * Change message * Make remove raceproof and improve comment * Reduce scope of changes for easier backport * Address comments to make code simpler

…6659) * Include BLIP context ID in _blipsync response with `X-Correlation-ID` header

* CBG-3591 stream request body from file to allow for >2GB files * replaces python 2 API with a python 3 API

* CBG-3763: setup 3.1.4 builds * Update manifest/product-config.json Co-authored-by: Ben Brooks <[email protected]> --------- Co-authored-by: Ben Brooks <[email protected]>

* Put UserXattrStore into DataStore to avoid need to typecast

…6682)

* Add redoc.ly OpenAPI preview links when PR updates these files * fix typos in OpenAPI specs * bump SG version in OpenAPI specs

* Move OpenAPI commenting action to own workflow only for PRs * Update .github/workflows/openapi-pr.yml

- use testify assertions when possible - don't check for deleted doc not existing at start of the test, we assert this via bucket pool - drop messages on assertions for xattr write functions since the function names - enable test that now works in rosmar

* Throttle concurrent revs (push and pull) to 5 for an individual replicating client * Consider proposeChanges as a changes batch for the inFlightChangesThrottle purposes * Make MaxConcurrentChangesBatches and MaxConcurrentRevs configurable * Add test and stats * Add stat descriptions * Fix config bug that the test found * Fix missing stat init for ISGR - split Connected Client rev throttle stat * PR comments for stats - add pull equivalent stat * Remove pull replication rev throttling (single-threaded) * int -> *int * Move replication throttle config to StartupConfig validation * Add test coverage for StartupConfig Validate for MaxConcurrentRevs * remove test logging

) * CBG-3641: Ignore read-only fields if values unchanged in User API * updates to address comments

* CBG-3688 make sure kv_pool_size is overriden correctly for DCP - create two functions for getting the connection string - GetGoCBConnString - GetGoCBConnStringForDCP Simplifications to API: - Fix a confusing invariant where GetGoCBConnString would initialize KvPoolSize on BucketSpec but making BucketSpec stateless and moving operations to be performed on an connection string - Remove redundant ca_cert_path, set by auth - Centralize modifying the connection string defaults for serverless on Bootstrap and Bucket creation.

…ection (#6690) * * Remove deprecated `lint` config. * Disable `security-defined` linter until we document what is public * Add OpenAPI spec readme - will populate with more info another time * Bump action version

…ull` `admin_channels` / `admin_roles` (#6691) * Add test to repro CBG-3610 * Allow `nil` ExplicitChannels to remove the set of admin channels/roles for a user * Fix TestSessionPasswordInvalidation relying on buggy behaviour of User API * Use GetUserPayload test helper and check roles as well

- add checks for json marshaling everywhere except benchmark code

…6694)

…6695) * Cherry-pick 3.1.4-fix to slow down rosmar tests

VULN-4266, VULN-4334, VULN-4330

This silences VULN-4267, but these CVEs do not affect Sync Gateway.

* Add new targets for generating internal apis * Address lint issues with newest redocly api

* Add handling and test for get all doc channels * Fix lint * Add licensing * Address comments * Add docs * fix yamllint * Add DocumentHistoryMaxEntriesPerChannel test case and fix docs * Denote compacted sequence pairs with ~ * Fix goimports * Fix comment * Fix comment * Add unmarshalJSON handlign for compacted sequence pair

…es. (#6707)

* CBG-3279: log at info level for each operation error (add, delete and purge) keeping track of how many errors each one has so we can log once at end of compaction showing amount of errors for each operation throughout compaction run * incorrectly logged purged doc count not purged error count * address comments * final touches, better logging

* CBG-3702: setup 7.6.1 buckets for integration tests

…ronment variables (#6703) * CBG-3791: change getAuthScopeHandleCreateDB method to not expand environment variables * updates after review * updates off review * fix test for default collection

…6709) * Extend startBootstrapServerWithoutConfigPolling polling interval * tidy return * Use config from bucket to roll back if no previous version is found (config vbucket rollback/config restore) * wip * Mark conflicting rollbacks as invalid in db registry and prevent loading by SG. Allows for manual repair of database config. * Improve log message for invalid database configurations - handle multiple scenarios * Handle unknown reasons why a db could be invalid * Do database repair via normal Admin REST API rather to ensure externally recoverable * Equal(len())->Len() * Rename stat * UD->MD fix * lower retry timeout for testing * Require 3 datastores * Replace registry entry with one built from config * Reword unexpected InvalidDatabase case * Push mutliDatabsaeRollback into subtest * fix ineffassign * Fix non-deterministic slice ordering from RequireInvalidDatabaseConfigNames helper

* Bump Go to 1.21.8 * Bump CI

* CBG-3813 add insertion strings to capture stdout/stderr * Remove Message which is always going to say Incorrect function

* Auto-convert equal assertions to Len helper * Lenf variants

…ter exceeding retry attempts (#6720) * Bail out of config updates when the registry write fails after exceeding retry attempts

* CBG-3278: move elixir stats behind serverless flag * tidy up * test fixes * remove sync function from rest tester, then alter tests to not use this if non default sync function is needed + adding stats options struct

…d logging (#6728)

- skip test on CBS 7.6

* Spin master into 3.3 and continue building 4.0 on separate branch * Bump 3.2 start build * bump master API version * Move most 3.2 stats to 3.3 * Change 4.0 branch name

* Update dependabot.yml to pull from private registry * Update .github/dependabot.yml Co-authored-by: Ben Brooks <[email protected]> --------- Co-authored-by: Ben Brooks <[email protected]>

Bumps [github.com/gorilla/mux](https://github.com/gorilla/mux) from 1.8.0 to 1.8.1. - [Release notes](https://github.com/gorilla/mux/releases) - [Commits](gorilla/mux@v1.8.0...v1.8.1) --- updated-dependencies: - dependency-name: github.com/gorilla/mux dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

Bumps [golang.org/x/oauth2](https://github.com/golang/oauth2) from 0.14.0 to 0.18.0. - [Commits](golang/oauth2@v0.14.0...v0.18.0) --- updated-dependencies: - dependency-name: golang.org/x/oauth2 dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

Bumps google.golang.org/protobuf from 1.32.0 to 1.33.0. --- updated-dependencies: - dependency-name: google.golang.org/protobuf dependency-type: indirect ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

Co-authored-by: adamcfraser <[email protected]>

- define common interfaces in sg-bucket for XDCR and related structs - move test to use NewXDCR to allow it to run the same test with CBS or rosmar cleanup: - define DataStoreName on Collection object to avoid casting

- xdcr tests have timing issues with creating an XDCR bucket to bucket replication and do not run 95% of the time. - fix an error with defer bucket.Close() where the tests would panic

Bumps [github.com/elastic/gosigar](https://github.com/elastic/gosigar) from 0.14.2 to 0.14.3. - [Release notes](https://github.com/elastic/gosigar/releases) - [Changelog](https://github.com/elastic/gosigar/blob/master/CHANGELOG.md) - [Commits](elastic/gosigar@v0.14.2...v0.14.3) --- updated-dependencies: - dependency-name: github.com/elastic/gosigar dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* Cleanup tests - Create TB() helper functions to make it easier to pick up the right TB function since it can get reset or hard to pick up - use require.EventuallyT instead of testing.T.Fatalf to get tracebacks when they fail. Because these functions fail anyway, removed the return of boolean found. - switch panic to require statements

- changes defaults to enabled - update golangci-lint-action to v4 to avoid node deprecation warnings from action

* Combine MutationStore2, Collection, DataStoreName into DataStore This is cleanup from the introduction to rosmar. - rosmar.Collection and Collection already satisified the DataStoreName interface, so putting it as part of DataStore removes need for AsDataStoreName checks. - remove GetFeedType() checks since it will always return DCP - Remove StartTapFeed from leaky bucket because it was not being used. TestStopChangeCache was only running with xattrs disabled, but the test would pass even if the events arrived out of order, so the leaky bucket tap code was not being executed. - Reflect in documentation that DCP feed is always used. * Replace leaky bucket code for DCPMissingDocs

Commits on Sep 8, 2023

CBG-3377 : Set up builds for 3.1.2 (#6393 )

bbrks authored Sep 8, 2023

Configuration menu

View commit details

Copy full SHA for c660b5a

Browse repository at this point

Copy the full SHA

c660b5a View commit details

Browse the repository at this point in the history

Commits on Nov 15, 2023

CBG-3589 : Add 4.0.0 build (#6577 )

bbrks authored Nov 15, 2023

Configuration menu

View commit details

Copy full SHA for d75a09b

Browse repository at this point

Copy the full SHA

d75a09b View commit details

Browse the repository at this point in the history

Commits on Feb 9, 2024

CBG-3771 Update gocb to 2.7.1 (#6675 )

torcolvin authored Feb 9, 2024

Configuration menu

View commit details

Copy full SHA for dd1893a

Browse repository at this point

Copy the full SHA

dd1893a View commit details

Browse the repository at this point in the history

CBG-3764 update base implementation of XDCR in rosmar #6746

CBG-3764 update base implementation of XDCR in rosmar #6746

Commits on Aug 23, 2023

Commits on Aug 24, 2023

Commits on Aug 28, 2023

Commits on Aug 29, 2023

Commits on Aug 30, 2023

Commits on Aug 31, 2023

Commits on Sep 6, 2023

Commits on Sep 7, 2023

Commits on Sep 8, 2023

Commits on Sep 11, 2023

Commits on Sep 12, 2023

Commits on Sep 13, 2023

Commits on Sep 15, 2023

Commits on Sep 18, 2023

Commits on Sep 19, 2023

Commits on Sep 20, 2023

Commits on Sep 21, 2023

Commits on Sep 22, 2023

Commits on Sep 25, 2023

Commits on Sep 26, 2023

Commits on Sep 27, 2023

Commits on Sep 28, 2023

Commits on Sep 29, 2023

Commits on Oct 2, 2023

Commits on Oct 3, 2023

Commits on Oct 4, 2023

Commits on Oct 5, 2023

Commits on Oct 6, 2023

Commits on Oct 9, 2023

Commits on Oct 10, 2023

Commits on Oct 11, 2023

Commits on Oct 13, 2023

Commits on Oct 17, 2023

Commits on Oct 18, 2023

Commits on Oct 19, 2023

Commits on Oct 23, 2023

Commits on Oct 24, 2023

Commits on Oct 25, 2023

Commits on Oct 26, 2023

Commits on Oct 27, 2023

Commits on Oct 30, 2023

Commits on Nov 6, 2023

Commits on Nov 7, 2023

Commits on Nov 8, 2023

Commits on Nov 10, 2023

Commits on Nov 13, 2023

Commits on Nov 14, 2023

Commits on Nov 15, 2023

Commits on Nov 16, 2023

Commits on Nov 17, 2023

Commits on Nov 24, 2023

Commits on Nov 29, 2023

Commits on Nov 30, 2023

Commits on Dec 1, 2023

Commits on Dec 11, 2023

Commits on Dec 12, 2023

Commits on Dec 13, 2023

Commits on Dec 15, 2023

Commits on Dec 19, 2023

Commits on Dec 20, 2023

Commits on Dec 21, 2023

Commits on Jan 2, 2024

Commits on Jan 4, 2024

Commits on Jan 5, 2024

Commits on Jan 8, 2024

Commits on Jan 9, 2024

Commits on Jan 10, 2024

Commits on Jan 11, 2024

Commits on Jan 12, 2024

Commits on Jan 17, 2024

Commits on Jan 19, 2024

Commits on Jan 22, 2024

Commits on Jan 24, 2024

Commits on Jan 26, 2024

Commits on Jan 30, 2024

Commits on Feb 2, 2024

Commits on Feb 5, 2024

Commits on Feb 6, 2024