Releases: MuleSoft-AI-Chain-Project/mule-vectors-connector
Release version 0.3.0
🚨🚨🚨 Main Changes 🚨🚨🚨
-
🆕 Low-level operation organized in three different categories: Document, Embedding and Store.
- Each operation consume 1️⃣ service only based on the category it belongs to (📄 document → storage, 🔢 embedding → model provider and 🗄️ store → vector store).
- Each category has a specific ⚙️ configuration (Document Configuration, Embedding Configuration, Store Configuration) → You can now easily mix different services.
- Old "Composite" operations have been remove from the connector. Here the list:
[Composite] Add doc to store→ Replaced by concatenation of[Document] Load single+[Embedding] Generate from document+[Store] Add[Composite] Add folder to store→ Replaced by concatenation of[Document] Load list+[Embedding] Generate from document+[Store] Add[Composite] Query from store→ Replaced by concatenation of[Embedding] Generate from text+[Store] Query
-
🆕 Support for 🔌 connection providers. Once creating any configuration it will be possible to perform connection test (Community 🧑🧑🧒🧒 Ask).
-
🆕 📣📣📣📣📣 Support for external dependency (Community 🧑🧑🧒🧒 Ask ). This change is a BIG one and well documented on https://mac-project.ai/ . Log story short it will help lower the connector 🏋️ size and keep it under control when adding support for more services. You can learn more here.
-
😮 🐎 🐎 🐎 🐎 🐎 Now you can ingest documents X 🔟 time faster, only 👎 slowed down only by rate limiting enforced by Model Providers 🫨
-
📂 All docs completely reviewed accordingly to the above changes.
Supported Operations
📄 [Document]:
- Load single (text, pdf, ppt, pptx, xls, xlsx, doc, docx, etc.)
- Load list (text, pdf, ppt, pptx, xls, xlsx, doc, docx, etc.)
🔢 [Embedding]:
- Generate from Text
- Generate from Document
🗄️ [Store]
- Add
- List Sources
- Query
- Remove
Supported Services
🔢 Embedding Models
🗄️ Vector Stores
💾 Storage
Supported Java Versions
Mule 4 Runtime support for Java 8, Java 11, Java 17
What's Changed
- 🆕 Low-level operation organized in three different categories: Document, Embedding and Store.
- 🆕 Support for 🔌 connection providers. Once creating any configuration it will be possible to perform connection test (Community :ask: ).
- 🆕 📢 📢 📢 Support for external dependency (Community :ask: ). This change is a BIG one and well documented on https://mac-project.ai/ . Log story short it will help lower the connector :weight_lifter::skin-tone-2: size and keep it under control when adding support for more services. You can learn more here.
- 🔝 🤘 🤘 🤘 Now you can ingest documents X10 time faster, only 👎 slowed down only by rate limiting enforced by Model Providers.
Full Changelog: v0.2.50...v0.3.0
Release version 0.2.50
Mule 4 Runtime support for Java 8, Java 11, Java 17
All operations tested with all supported embedding models and vector databases
Embedding Models
Vector Stores
Storage
[Document]:
- Parse documents of type (text, pdf, ppt, pptx, xls, xlsx, doc, docx, etc.)
- Split documents of type (text, pdf, ppt, pptx, xls, xlsx, doc, docx, etc.)
[Embedding]:
- Add Text to Store
- Generate Embeddings from Text
- Add Document to Store
- Add Folder to Store
- Query from Store
- Query from Store with Filters
- List Sources
- Remove from Store with Filters
What's Changed
- Added support for Einstein. by @tbolis-at-mulesoft in #53
- Feature/enhanced module configuration by @tbolis-at-mulesoft in #58
- Feature/enhanced module configuration by @tbolis-at-mulesoft in #59
- Einstein Support and Module Configuration Refactoring by @tbolis-at-mulesoft in #60
Full Changelog: v0.2.0...v0.2.50
Contributors
Assets 2
Release version 0.2.0
Mule 4 Runtime support for Java 8, Java 11, Java 17
All operations tested with all supported embedding models and vector databases
Embedding Models
Vector Stores
Storage Provider
[Document]:
- Parse documents of type (text, pdf, ppt, pptx, xls, xlsx, doc, docx, etc.)
- Split documents of type (text, pdf, ppt, pptx, xls, xlsx, doc, docx, etc.)
[Embedding]:
- Add Text to Store
- Generate Embeddings from Text
- Add Document to Store
- Add Folder to Store
- Query from Store
- Query from Store with Filters
- List Sources
- Remove from Store with Filters
What's Changed
- v0.1.0 by @amirkhan-ak-sf in #5
- merge by @amirkhan-ak-sf in #6
- Develop by @amirkhan-ak-sf in #10
- Add HUGGING_FACE model support and fix model name filtering based on embeddingProviderType by @SurajKamal24 in #9
- changes by SurajKamal24 by @amirkhan-ak-sf in #11
- 3 operations added by @amirkhan-ak-sf in #15
- Add possibility to choose filter method by @tbolis-at-mulesoft in #16
- Add/s3 by @tbolis-at-mulesoft in #17
- Feature/custom metadata key by @tbolis-at-mulesoft in #18
- Fix bugs in listSources operation. by @tbolis-at-mulesoft in #19
- Bugfix/list sources by @tbolis-at-mulesoft in #20
- Fix Typo by @tbolis-at-mulesoft in #21
- Bugfix/list sources by @tbolis-at-mulesoft in #22
- Fix bug and add segment count at source level. by @tbolis-at-mulesoft in #23
- Implements list sources operation for milvus directly through milvus … by @tbolis-at-mulesoft in #24
- Bugfix/list sources by @tbolis-at-mulesoft in #25
- opensearch support added by @codedbyyogesh in #26
- Bugfix/list sources by @tbolis-at-mulesoft in #27
- Bugfix/list sources by @tbolis-at-mulesoft in #28
- Implements list sources operation for chroma directly through apis. B… by @tbolis-at-mulesoft in #29
- add ingestion timestamp as long value by @tbolis-at-mulesoft in #30
- Completely refactor store classes by @tbolis-at-mulesoft in #31
- Bugfix/list sources by @tbolis-at-mulesoft in #32
- Bugfix/list sources by @tbolis-at-mulesoft in #33
- changes to support maven central release by @rhoegg in #38
- Refactor/storage management by @tbolis-at-mulesoft in #39
- Refactor metadata management per storage by @tbolis-at-mulesoft in #40
- Refactor operation parameters by @tbolis-at-mulesoft in #42
- Refactor error handling and response handling by @tbolis-at-mulesoft in #43
- Refactor/storage management by @tbolis-at-mulesoft in #44
- Adding OSS standard files by @amirkhan-ak-sf in #45
- Develop by @tbolis-at-mulesoft in #46
- Text to Embedding now implements segmentation. by @tbolis-at-mulesoft in #47
- feat: Added Qdrant support by @Anush008 in #49
- feat: Auto-create Qdrant collection by @Anush008 in #50
- Develop by @tbolis-at-mulesoft in #51
New Contributors
- @SurajKamal24 made their first contribution in #9
- @tbolis-at-mulesoft made their first contribution in #16
- @codedbyyogesh made their first contribution in #26
- @rhoegg made their first contribution in #38
- @Anush008 made their first contribution in #49
Full Changelog: v0.1.0...v0.2.0
Contributors
Assets 2
Release version 0.1.0
Mule 4 Runtime support for Java 8, Java 11, Java 17
All operations tested with all supported embedding models and vector databases
Embedding Models
Vector Stores
The initial release of the MuleChain AI connector supports the following operations, categorized into different topics for ease of use:
- [Document]:
- Parse documents of type (text, pdf, ppt, pptx, xls, xlsx, doc, docx, etc.)
- Split documents of type (text, pdf, ppt, pptx, xls, xlsx, doc, docx, etc.)
- [Embedding]:
- Add Text to Store
- Add Document to Store
- Add Folder to Store
- Query from Store