Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

#4292 - ollama based recommender #4296

Merged
merged 31 commits into from
Dec 5, 2023
Merged

Conversation

reckart
Copy link
Member

@reckart reckart commented Nov 14, 2023

What's in the PR

  • Basic ollama-based recommender (highly experimental)

How to test manually

  • Start a local ollama
  • Configure INCEpTION with recommender.ollama.enabled=true in the settings.properties or using a system property

Automatic testing

  • PR includes unit tests

Documentation

  • PR updates documentation

- Basic ollama-based recommender (highly experimental)
- Added different generation and extraction mechanisms
- Support JSON mode
- Remove dependency on ollama4j for the moment and use own client implementation
@reckart reckart added this to the 31.0 milestone Nov 14, 2023
@reckart reckart self-assigned this Nov 14, 2023
* main:
  #4294 - Infer paragraph boundaries when displaying plain text files in HTML-based editors
  #4289 - Ability to skip SSL certificate validation on external recommenders
@reckart reckart force-pushed the feature/4292-ollama-based-recommender branch from 659e83b to cced7fd Compare November 14, 2023 16:17
- Clean up dependencies
@reckart reckart force-pushed the feature/4292-ollama-based-recommender branch from cced7fd to f43561b Compare November 14, 2023 16:38
- Added simple preset mechanism with pre-define presets (i.e. users cannot define their own presets...)
- Added another preset
- Allow accessing the surrounding sentence in the per-annotation processing mode
@reckart reckart force-pushed the feature/4292-ollama-based-recommender branch from 5479205 to 685e65d Compare November 14, 2023 18:25
@reckart reckart force-pushed the feature/4292-ollama-based-recommender branch from fc42860 to 631577b Compare November 14, 2023 20:52
* main:
  #4302 - Files imported as HTML do not show properly in HTML-based editor
  #4305 - New predictions message is shown even if no new predictions were generated
  #4304 - Log more startup messages through boot logger
* main:
  #4308 - Support for custom XML formats
  #4229 - Better project template selection
* main:
  #4308 - Support for custom XML formats
  #4308 - Support for custom XML formats
  #4310 - Viewport tracking does not work well in RecogitoJS editor
- Renaming classes
* main:
  #4314 - Move project API to own module
  #4308 - Support for custom XML formats
* main:
  #4316 - Dissolve generic API module
  #4316 - Dissolve generic API module
  #4316 - Dissolve generic API module
  #4316 - Dissolve generic API module
  #4316 - Dissolve generic API module
  #4316 - Dissolve generic API module
* main:
  #4229 - Better project template selection
  #4289 -  Ability to skip SSL certificate validation on external recommenders
  #4289 -  Ability to skip SSL certificate validation on external recommenders
@reckart reckart changed the base branch from main to release/30.x November 23, 2023 18:24
* release/30.x:
  No issue. Fix test.
  [maven-release-plugin] prepare for next development iteration
  [maven-release-plugin] prepare release inception-29.9
* main:
  #34 - Update dependencies
  #4150 - Upgrade dependencies
  #4321 - Organize packages
  #4321 - Organize packages
  #4321 - Organize packages
  #4321 - Organize packages
  #4321 - Organize packages
  #4321 - Organize packages
  #4321 - Organize packages
  #4321 - Organize packages
  #4321 - Organize packages
  [maven-release-plugin] prepare for next development iteration
  [maven-release-plugin] prepare release inception-30.0-rc-1
  #4229 - Better project template selection
  [maven-release-plugin] prepare for next development iteration
  [maven-release-plugin] prepare release inception-30.0-rc-1
  No issue: Set version to 31.0-SNAPSHOT

% Conflicts:
%	inception/inception-recommendation/src/main/java/de/tudarmstadt/ukp/inception/recommendation/service/RecommendationServiceImpl.java
- Refactored prompt generation and response extraction
@reckart reckart force-pushed the feature/4292-ollama-based-recommender branch from 0c6bfec to 7b88375 Compare November 26, 2023 20:39
- Steps towards providing context to prompt templates
- Steps towards few-shot predictions
- Added few-shot example
- Fix handling of JSON responses consisting of numbers
- Towards configurable advanced options
* main:
  No issue: Route message through boot logger.
* main:
  #4328 - HTML files are not rendered if they use the HTML namespace
  #4326 - Upgrade dependencies
  #4324 - Allow configuring UID GID etc in Kubernetes
- Template variable hints
* main:
  #4330 - Remove default memory limit for INCEpTION in Dockerfile
  #4229 - Better project template selection
  #4330 - Remove default memory limit for INCEpTION in Dockerfile
  #4229 - Better project template selection
@reckart reckart force-pushed the feature/4292-ollama-based-recommender branch from 40ac46d to ef92437 Compare December 1, 2023 20:38
@reckart reckart changed the base branch from release/30.x to main December 2, 2023 11:52
* main:
  #4347 - CAS doctor fails to generate a proper report on projects not containing INITIAL_CASes
  #4349 - Project has date in the 70ies if no data is set in JSON
  #4344 - Allow format to inject default namespace if document does not specify one
  #4342 - Show document size in documents table
  #4342 - Show document size in documents table
  No issue: Optimize tracking be excluding elements that contain no text
  No issue: Avoid scrollbar appearing at wrong level
  #4340 - Allow pruning elements in XML policy
  #4338 - Spurious empty annotations in RecogitoJS editor
  #4324 - Allow configuring UID GID etc in Kubernetes
  #4335 - Promote UIMA JSON CAS 0.4.0 to non-experimental
  #4326 - Upgrade dependencies
@reckart reckart marked this pull request as ready for review December 5, 2023 16:02
@reckart reckart merged commit 63e33f7 into main Dec 5, 2023
1 check passed
@reckart reckart deleted the feature/4292-ollama-based-recommender branch December 5, 2023 20:52
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant