Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: Add Azure AI Search integration #1122

Merged
merged 27 commits into from
Nov 7, 2024
Merged
Show file tree
Hide file tree
Changes from 1 commit
Commits
Show all changes
27 commits
Select commit Hold shift + click to select a range
3ebaa49
CRUD operations and tests for document store
Amnah199 Oct 2, 2024
e5227a6
Add embedding retriever and tests
Amnah199 Oct 14, 2024
875d075
Add comparison filters logic
Amnah199 Oct 16, 2024
a0a45df
Fix errors
Amnah199 Oct 17, 2024
8b4b59f
Fix filter tests
Amnah199 Oct 18, 2024
42161ef
Add filters with tests
Amnah199 Oct 18, 2024
f07943e
Prepare files for review
Amnah199 Oct 23, 2024
f383d46
Delete integrations/azure_ai_search/CHANGELOG.md
Amnah199 Oct 23, 2024
4bf9b5b
Delete integrations/azure_ai_search/README.md
Amnah199 Oct 23, 2024
4a5e718
Add github workflow
Amnah199 Oct 23, 2024
49687ca
Add README file
Amnah199 Oct 23, 2024
162811a
Fix config files
Amnah199 Oct 23, 2024
990be6a
Fix linting errors
Amnah199 Oct 24, 2024
9f35b57
Add examples
Amnah199 Oct 25, 2024
48b507f
Fix conftest
Amnah199 Oct 25, 2024
bc347b9
Fix the conftest
Amnah199 Oct 25, 2024
485960b
Fix iso-date format
Amnah199 Oct 25, 2024
89ff7aa
Add instructions to examples
Amnah199 Oct 25, 2024
d84ced9
Config matrix for CI tests
Amnah199 Oct 25, 2024
c42c1f4
Update the example based on review
Amnah199 Oct 28, 2024
54570e3
Fix linting
Amnah199 Oct 28, 2024
b9563ba
Fix ser/deserialization
Amnah199 Oct 28, 2024
23d1e22
Add a check for index schema
Amnah199 Oct 29, 2024
3afc3b9
Updated code based on PR comments
Amnah199 Oct 31, 2024
d4793e8
Fixes and nested filters logic
Amnah199 Nov 6, 2024
f94944e
Reducing parallel tests for CI
Amnah199 Nov 6, 2024
191de7b
Merge branch 'main' into feat-azure-ai-search-integration
Amnah199 Nov 7, 2024
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
163 changes: 163 additions & 0 deletions integrations/azure_ai_search/.gitignore
Original file line number Diff line number Diff line change
@@ -0,0 +1,163 @@
# Byte-compiled / optimized / DLL files
Amnah199 marked this conversation as resolved.
Show resolved Hide resolved
__pycache__/
*.py[cod]
*$py.class

# C extensions
*.so

# Distribution / packaging
.Python
build/
develop-eggs/
dist/
downloads/
eggs/
.eggs/
lib/
lib64/
parts/
sdist/
var/
wheels/
share/python-wheels/
*.egg-info/
.installed.cfg
*.egg
MANIFEST

# PyInstaller
# Usually these files are written by a python script from a template
# before PyInstaller builds the exe, so as to inject date/other infos into it.
*.manifest
*.spec

# Installer logs
pip-log.txt
pip-delete-this-directory.txt

# Unit test / coverage reports
htmlcov/
.tox/
.nox/
.coverage
.coverage.*
.cache
nosetests.xml
coverage.xml
*.cover
*.py,cover
.hypothesis/
.pytest_cache/
cover/

# Translations
*.mo
*.pot

# Django stuff:
*.log
local_settings.py
db.sqlite3
db.sqlite3-journal

# Flask stuff:
instance/
.webassets-cache

# Scrapy stuff:
.scrapy

# Sphinx documentation
docs/_build/

# PyBuilder
.pybuilder/
target/

# Jupyter Notebook
.ipynb_checkpoints

# IPython
profile_default/
ipython_config.py

# pyenv
# For a library or package, you might want to ignore these files since the code is
# intended to run in multiple environments; otherwise, check them in:
# .python-version

# pipenv
# According to pypa/pipenv#598, it is recommended to include Pipfile.lock in version control.
# However, in case of collaboration, if having platform-specific dependencies or dependencies
# having no cross-platform support, pipenv may install dependencies that don't work, or not
# install all needed dependencies.
#Pipfile.lock

# poetry
# Similar to Pipfile.lock, it is generally recommended to include poetry.lock in version control.
# This is especially recommended for binary packages to ensure reproducibility, and is more
# commonly ignored for libraries.
# https://python-poetry.org/docs/basic-usage/#commit-your-poetrylock-file-to-version-control
#poetry.lock

# pdm
# Similar to Pipfile.lock, it is generally recommended to include pdm.lock in version control.
#pdm.lock
# pdm stores project-wide configurations in .pdm.toml, but it is recommended to not include it
# in version control.
# https://pdm.fming.dev/#use-with-ide
.pdm.toml

# PEP 582; used by e.g. github.com/David-OConnor/pyflow and github.com/pdm-project/pdm
__pypackages__/

# Celery stuff
celerybeat-schedule
celerybeat.pid

# SageMath parsed files
*.sage.py

# Environments
.env
.venv
env/
venv/
ENV/
env.bak/
venv.bak/

# Spyder project settings
.spyderproject
.spyproject

# Rope project settings
.ropeproject

# mkdocs documentation
/site

# mypy
.mypy_cache/
.dmypy.json
dmypy.json

# Pyre type checker
.pyre/

# pytype static type analyzer
.pytype/

# Cython debug symbols
cython_debug/

# PyCharm
# JetBrains specific template is maintained in a separate JetBrains.gitignore that can
# be found at https://github.com/github/gitignore/blob/main/Global/JetBrains.gitignore
# and can be added to the global gitignore or merged into this file. For a more nuclear
# option (not recommended) you can uncomment the following to ignore the entire idea folder.
#.idea/

# VS Code
.vscode
99 changes: 99 additions & 0 deletions integrations/azure_ai_search/CHANGELOG.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,99 @@
# Changelog

## [integrations/opensearch-v0.8.1] - 2024-07-15

### 🚀 Features

- Add raise_on_failure param to OpenSearch retrievers (#852)
- Add filter_policy to opensearch integration (#822)

### 🐛 Bug Fixes

- `OpenSearch` - Fallback to default filter policy when deserializing retrievers without the init parameter (#895)

### ⚙️ Miscellaneous Tasks

- Update ruff invocation to include check parameter (#853)

## [integrations/opensearch-v0.7.1] - 2024-06-27

### 🐛 Bug Fixes

- Serialization for custom_query in OpenSearch retrievers (#851)
- Support legacy filters with OpenSearchDocumentStore (#850)

## [integrations/opensearch-v0.7.0] - 2024-06-25

### 🚀 Features

- Defer the database connection to when it's needed (#753)
- Improve `OpenSearchDocumentStore.__init__` arguments (#739)
- Return_embeddings flag for opensearch (#784)
- Add create_index option to OpenSearchDocumentStore (#840)
- Add custom_query param to OpenSearch retrievers (#841)

### 🐛 Bug Fixes

- Fix order of API docs (#447)

This PR will also push the docs to Readme

### 📚 Documentation

- Update category slug (#442)
- Fixing opensearch docstrings (#521)
- Small consistency improvements (#536)
- Disable-class-def (#556)

### ⚙️ Miscellaneous Tasks

- Retry tests to reduce flakyness (#836)

### Opensearch

- Generate API docs (#324)

## [integrations/opensearch-v0.2.0] - 2024-01-17

### 🐛 Bug Fixes

- Fix links in docstrings (#188)



### 🚜 Refactor

- Use `hatch_vcs` to manage integrations versioning (#103)

## [integrations/opensearch-v0.1.1] - 2023-12-05

### 🐛 Bug Fixes

- Fix import and increase version (#77)



## [integrations/opensearch-v0.1.0] - 2023-12-04

### 🐛 Bug Fixes

- Fix license headers


## [integrations/opensearch-v0.0.2] - 2023-11-30

### 🚀 Features

- Extend OpenSearch params support (#70)

### Build

- Bump OpenSearch integration version to 0.0.2 (#71)

## [integrations/opensearch-v0.0.1] - 2023-11-30

### 🚀 Features

- [OpenSearch] add document store, BM25Retriever and EmbeddingRetriever (#68)

<!-- generated by git-cliff -->
Loading