Skip to content
This repository has been archived by the owner on Mar 21, 2024. It is now read-only.

Auto-batching - Enable feature by default and remove unwanted options #162

Merged
merged 5 commits into from
Oct 3, 2022

Conversation

curquiza
Copy link
Member

@curquiza curquiza commented Jul 20, 2022

🤖 API Diff


Summary

Following meilisearch/meilisearch#2582

Enables auto batching by default and removes unnecessary options.


Changes

  • Auto-batching is now activated by default. It involves the --enable-auto-batching flag being removed and replaced by --disable-auto-batching. An environment variable should also be added to handle this option (MEILI_DISABLE_AUTO_BATCHING)
  • Remove all the current options: --debounce-duration-sec, --max-batch-size and --max-documents-per-batch.
  • Remove the batchUid field in task object; It's now an internal field not being displayed.

Out Of Scope

N/A


Attention To Reviewers

N/A


Misc

  • Update OpenAPI specification file (if needed; Apply the OpenApi label)
  • Update telemetry datapoints (if needed; Apply the Telemetry label)

@curquiza curquiza changed the title Update specs according to new auto-batching behavior New auto-batching behavior: enabled by default Jul 20, 2022
@curquiza curquiza changed the title New auto-batching behavior: enabled by default New auto-batching behavior: enabled by default + remove useless options Jul 20, 2022
text/0096-auto-batching.md Outdated Show resolved Hide resolved
@gmourier gmourier added the Ready For Review Feature specification must be reviewed. label Aug 2, 2022
@gmourier gmourier mentioned this pull request Aug 2, 2022
1 task
@gmourier gmourier changed the title New auto-batching behavior: enabled by default + remove useless options Auto-batching - enabled by default + remove useless options Aug 2, 2022
Copy link
Member

@gmourier gmourier left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The content LGTM! Thanks @curquiza.

I've put some suggestions regarding the <s></s> format given our future discussion.

text/0096-auto-batching.md Outdated Show resolved Hide resolved
text/0096-auto-batching.md Outdated Show resolved Hide resolved
@github-actions
Copy link

github-actions bot commented Aug 18, 2022

🚨 Breaking API change detected:

Modified (2)

  • GET /tasks
    • Response modified: 200
      • Attribute modified: results
  • GET /tasks/:taskUid
    • Response modified: 200
      • [Breaking] Attribute removed: batchUid

View documentation diff

Powered by Bump

@gmourier
Copy link
Member

Updated the specification to map the meilisearch/meilisearch#2676 changes.

@gmourier gmourier added OpenAPI Update OpenAPI specification. Telemetry Update the telemetry collect. labels Aug 24, 2022
@gmourier gmourier changed the title Auto-batching - enabled by default + remove useless options Auto-batching - Enable feature by default and remove unwanted options Sep 29, 2022
open-api.yaml Outdated Show resolved Hide resolved
@gmourier gmourier merged commit 99367d2 into develop Oct 3, 2022
@gmourier gmourier deleted the update-auto-batching branch October 3, 2022 14:36
@gmourier gmourier added Implemented Feature specification has been implemented. and removed Ready For Review Feature specification must be reviewed. labels Oct 3, 2022
gmourier added a commit that referenced this pull request Oct 3, 2022
…#162)

* Update specs according to new auto-batching behavior

* update batchUid to make it internal and hidden from a task resource representation

* Remove the batchUid mentions from the task API

* Update open-api.yaml

Co-authored-by: Guillaume Mourier <[email protected]>

* update future possibilities

Co-authored-by: Guillaume Mourier <[email protected]>
gmourier added a commit that referenced this pull request Oct 3, 2022
* Bump openapi spec version to v0.29

* Update 0001-script-based-tokenizer.md (#159)

Change tokenizer specs to better fit Charabia implementation

* Update the geosearch error (#161)

Implemented in meilisearch/milli#561

* Auto-batching - Enable feature by default and remove unwanted options (#162)

* Update specs according to new auto-batching behavior

* update batchUid to make it internal and hidden from a task resource representation

* Remove the batchUid mentions from the task API

* Update open-api.yaml

Co-authored-by: Guillaume Mourier <[email protected]>

* update future possibilities

Co-authored-by: Guillaume Mourier <[email protected]>

* Search API — Filters - Introduce IN and EXISTS and describe filter capabilities in more precisely (#163)

* Write a specification for the new (and old) search filters

EXISTS
IN
NOT (new behaviour)
!= (new behaviour)

* Apply suggestions from code review

Co-authored-by: Tamo <[email protected]>
Co-authored-by: Guillaume Mourier <[email protected]>

Co-authored-by: Tamo <[email protected]>
Co-authored-by: Guillaume Mourier <[email protected]>

* Add missing settings object in the task details field of a settingsUpdate task type (#164)

* Remove `name` from indexes resource definition (#165)

* Misc — Soft deleted documents (Performance optimization) (#168)

* create a spec for the soft deleted documents

* Rename spec file, minor adjustements

* Replace You and We by A user and Meilisearch

Co-authored-by: Guillaume Mourier <[email protected]>

* Add Stats Seen event (#169)

* Add examples component for each summarized task type (#170)

* Version API — Catch up (#171)

* Add version-api.md

* Add PR number as a spec file prefix

* Add health-api.md (#172)

* Search API — Add `matchingStrategy` parameter with `last` / `all` strategies (#173)

* Introduce a proposal to boot the specification

* Update telemetry

* Replace wordMatchingStrategy by matchingStrategy

* fix missing backtick md

Co-authored-by: Many the fish <[email protected]>
Co-authored-by: Tamo <[email protected]>
Co-authored-by: Clémentine Urquizar - curqui <[email protected]>
Co-authored-by: Loïc Lecrenier <[email protected]>
Co-authored-by: cvermand <[email protected]>
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
Implemented Feature specification has been implemented. OpenAPI Update OpenAPI specification. Q3:2022 Telemetry Update the telemetry collect. v0.29
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants