Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

semantic text bulk inference integration test #17

Conversation

carlosdelest
Copy link
Owner

Created an IT for bulk ingestion using semantic_text.

Base branch is the current open PR for ingestion. I'd prefer to merge that first before this one to avoid noise, and open it as a follow up.

I've done an IT that mixes bulk operations (index, update, upsert) on an index, and tests the number of documents in the index. I've relied heavily on randomness to get test coverage.

@@ -27,14 +27,6 @@

public abstract class AbstractTestInferenceService implements InferenceService {

protected static int stringWeight(String input, int position) {
Copy link
Owner Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Moved to specific methods on the different dense and sparse vector mock services

@@ -43,8 +44,22 @@ public List<Factory> getInferenceServiceFactories() {
return List.of(TestInferenceService::new);
}

public static class TestDenseModel extends Model {
Copy link
Owner Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Added mock models as well

@carlosdelest carlosdelest changed the title Carlosdelest/semantic text ingestion inference integ test semantic text bulk inference integration test May 10, 2024
@carlosdelest
Copy link
Owner Author

Addressing merge into main in elastic#108550

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant