Block and Vector creation can start to use a block factory that performs circuit breaking - 8.12

[nik9000]

Extends #99173

Description

This meta issue lists a number of places in the ESQL runtime where Block and Vector creation can start to use a block factory that performs breaking/accountancy that needs to land in 8.12.

• [CI] HeapAttackIT testManyConcat failing #100678
• [CI] HeapAttackIT testGroupOnManyLongs failing #100640
• [CI] HeapAttackIT testSortByManyLongsTooMuchMemory failing #102683
• Reference tracking ESQL: Make blocks ref counted #100408
• Remove copy operations
  • Deep copy on aliases ESQL: Make blocks ref counted #100408
  • Deep copy in eval ESQL: Make blocks ref counted #100408
  • Copy in filter @alex-spies Update: not planned, currently not clear whether this really improves performance.
  • Copy in expand ESQL: shallow copy in EXPAND via shared vecs #103681
• operators (all not covered in Block and Vector creation can start to use a block factory that performs circuit breaking #99826
  • Enrich @dnhatn
  • LuceneSource @nik9000 ESQL: Track blocks emitted from lucene #101396
  • doc values reading @nik9000 ESQL: Track memory from values loaded from lucene #101383
  • stored field reading @nik9000 ESQL: Track memory from values loaded from lucene #101383
  • dissect ESQL: Enable block tracking in extract tests #101400
• generate toString for ExpressionEvaluator.Factory and remove ThrowingDriverContext from EvalOperatorFactory.describe ESQL: Generate evaluator factories #100516
• Move BlockFactory.getNonBreakingInstance() to tests only (Remove non-breaking block factory from production code #103661)
• Make sure that many many many small pages don't fill up memory without filling the breaker. See testTooManyEval.
• Remove Block.Ref (Replace Block.Ref with Block reference count #102513)
• Remove deprecated Block methods
• BytesRef does allocation that can’t be tracked when going across a page boundary (ESQL: Fix rare bug with empty string #102350)

[elasticsearchmachine]

Pinging @elastic/es-ql (Team:QL)

[elasticsearchmachine]

Pinging @elastic/elasticsearch-esql (:Query Languages/ES|QL)

[elasticsearchmachine]

Pinging @elastic/es-analytics-geo (Team:Analytics)

[alex-spies]

Sorry, the GH bot auto-closed this.

[dnhatn]

Closing this in favor of #104110 for remaining items.