Skip to content

Commit

Permalink
Update tiktoken package to provide support for GPT4o (#4)
Browse files Browse the repository at this point in the history
  • Loading branch information
jirispilka authored Jun 17, 2024
1 parent 0ee532f commit 46b0fed
Show file tree
Hide file tree
Showing 3 changed files with 368 additions and 365 deletions.
16 changes: 14 additions & 2 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -19,9 +19,9 @@ The integration process includes:
- Loading data from an Apify Actor
- Processing the data to comply with OpenAI Assistant limits (max. 1000 files, max 5,000,000 tokens)
- Creating OpenAI files [OpenAI Files](https://platform.openai.com/docs/api-reference/files)
- [Optional] Removing existing files from the Vector Store (specified by `fileIdsToDelete` and/or `filePrefix`)
- _[Optional]_ Removing existing files from the Vector Store (specified by `fileIdsToDelete` and/or `filePrefix`)
- Adding the newly created files to the vector store.
- [Optional] Deleting existing files from the OpenAI files (specified by `fileIdsToDelete` and/or `filePrefix`)
- _[Optional]_ Deleting existing files from the OpenAI files (specified by `fileIdsToDelete` and/or `filePrefix`)

## How much does it cost?
Find the average usage cost for this actor on the [pricing page](https://apify.com/pricing) under the `Which plan do I need?` section.
Expand Down Expand Up @@ -65,3 +65,15 @@ Utilize the Apify platform to [gather data for your large language models](https
Our Actors can automatically ingest entire websites, such as customer documentation, knowledge bases, help centers,
forums, blog posts, and other information sources to train or prompt your LLMs.
Integrate Apify into your product and allow your customers to upload their content in minutes.

## Example usage

```json
{
"assistantId": "YOUR-ASSISTANT-ID",
"datasetFields": ["text", "url", "metadata.title"],
"filePrefix": "apify_test_",
"openaiApiKey": "YOUR-OPENAI-API-KEY",
"vectorStoreId": "YOUR-VECTOR-STORE-ID"
}
```
Loading

0 comments on commit 46b0fed

Please sign in to comment.