Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Release 2.3.22 #363

Merged
merged 43 commits into from
Sep 26, 2024
Merged

Release 2.3.22 #363

merged 43 commits into from
Sep 26, 2024

Conversation

karthikscale3
Copy link
Collaborator

Description

This PR introduces support for the following:

  • Support for LiteLLM
  • Experiment tracking for DSPy experiments. Note that, for experiments to show up, pass the following additional attributes using the inject_additional_attributes. This way Langtrace knows that you are running an experiment:
  1. (Required) experiment - Experiment name. Ex: experiment 1.
  2. (Optional) description - Some useful description about the experiment.
  3. (Optional) run_id - When you want to associate traces to a specific runs, pass a unique run ID. This is useful when you are running Evaluate() as part of your experiment where the traces specific to the Evaluate() will appear as an individual entry.
  • The Eval Chart on Langtrace Client will appear when you run Evaluate(). Note: Currently the score ranges it supports are between 0 and 100. So if you have scores that do not fall within this range, it could cause some UI issues.
from langtrace_python_sdk import inject_additional_attributes

predictor = inject_additional_attributes(lambda: compiled_rag(my_question), {'experiment': 'experiment 1', 'description': 'some useful description', 'run_id': 'run_1'})

Checklist for adding new integration:

  • Defined APIS in constants folder.
  • Updated SERVICE_PROVIDERS in common.py
  • Created a folder under instrumentation with the name of the integration with atleast patch.py and instrumentation.py files.
  • Added instrumentation in all_instrumentations in langtrace.py and to the InstrumentationType in types.py files.
  • Added examples for the new integration in the examples folder.
  • Updated pyproject.toml to install new dependencies
  • Updated the README.md of langtrace-python-sdk to include the new integration in the supported integrations table.
  • Updated the README.md of Langtrace's repository to include the new integration in the supported integrations table.
  • Added new integration page to supported integrations in Langtrace Docs

@karthikscale3 karthikscale3 changed the title Release Release 2.3.22 Sep 26, 2024
@karthikscale3 karthikscale3 merged commit 5273fdd into main Sep 26, 2024
4 checks passed
@karthikscale3 karthikscale3 deleted the release branch September 26, 2024 00:51
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant