ccl/workloadccl: BenchmarkImportFixture fails with memory budget exceeded

[herkolategan]

--- FAIL: BenchmarkImportFixture/tpcc/warehouses=1
    bench_test.go:42: 
        	Error Trace:	/mnt/data1/microbench/pkg/ccl/workloadccl/bin/bench_test.go:42
        	            				/mnt/data1/microbench/pkg/ccl/workloadccl/bin/bench_test.go:55
        	            				/mnt/data1/microbench/pkg/ccl/workloadccl/bin/benchmark.go:193
        	            				/mnt/data1/microbench/pkg/ccl/workloadccl/bin/benchmark.go:233
        	            				/mnt/data1/microbench/pkg/ccl/workloadccl/bin/asm_amd64.s:1594
        	Error:      	Received unexpected error:
        	            	importing table history: pq: not enough memory available to create a BulkAdder: root: memory budget exceeded: 33554432 bytes requested, 103008256 currently allocated, 134217728 bytes in budget
        	            	(1) attached stack trace
        	            	  -- stack trace:
        	            	  | github.com/cockroachdb/cockroach/pkg/ccl/workloadccl.ImportFixture.func1
        	            	  | 	github.com/cockroachdb/cockroach/pkg/ccl/workloadccl/fixture.go:404
        	            	  | github.com/cockroachdb/cockroach/pkg/util/ctxgroup.Group.GoCtx.func1
        	            	  | 	github.com/cockroachdb/cockroach/pkg/util/ctxgroup/ctxgroup.go:168
        	            	  | golang.org/x/sync/errgroup.(*Group).Go.func1
        	            	  | 	golang.org/x/sync/errgroup/external/org_golang_x_sync/errgroup/errgroup.go:75
        	            	  | runtime.goexit
        	            	  | 	GOROOT/src/runtime/asm_amd64.s:1594
        	            	Wraps: (2) importing table history
        	            	Wraps: (3) pq: not enough memory available to create a BulkAdder: root: memory budget exceeded: 33554432 bytes requested, 103008256 currently allocated, 134217728 bytes in budget
        	            	Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *pq.Error
        	Test:       	BenchmarkImportFixture/tpcc/warehouses=1
--- FAIL: BenchmarkImportFixture
FAIL

Note:

pq: not enough memory available to create a BulkAdder: root: memory budget exceeded: 33554432

To reproduce:

./dev bench pkg/ccl/workloadccl -f=BenchmarkImportFixture --ignore-cache --bench-time=1s --verbose --stream-output --timeout 120m

Jira issue: CRDB-23895

[blathers-crl]

cc @cockroachdb/test-eng

[srosenberg]

Reducing ingest buffer sizes should address the memory issue [1]. My understanding is some recent change is allocating several more MBs when using a TestServer, subsequently causing the total SQL execution memory budget to be exceeded.

[1] #94010