genai: add system_fingerprint attribute

[xrmx]

Changes

Add system_fingerprint attribute to genai to track the value from the OpenAI api response as requested in https://github.com/open-telemetry/opentelemetry-python-contrib/pull/2759/files/6383978266d85eb058fd8030e8da2b83e6d90043#r1710313834

Merge requirement checklist

• CONTRIBUTING.md guidelines followed.
• Change log entry added, according to the guidelines in When to add a changelog entry.
  • If your PR does not need a change log, start the PR title with [chore]
• schema-next.yaml updated with changes to existing conventions.

[drewby]

I have two questions:

1. Can we confirm that this is returned from more vendors/models than OpenAI?
2. How often does system_fingerprint change? If its low cardinality enough, I'd suggest adding this to the metric as well as a good way to correlate between fingerprint changes and degradations/changes in app performance.

[xrmx]

I have two questions:

1. Can we confirm that this is returned from more vendors/models than OpenAI?

I think it's mostly OpenAI specific, not found something similar in Mistral or Anthropic APIs.

2. How often does system_fingerprint change? If its low cardinality enough, I'd suggest adding this to the metric as well as a good way to correlate between fingerprint changes and degradations/changes in app performance.

I don't know

[drewby]

I have two questions:

1. Can we confirm that this is returned from more vendors/models than OpenAI?

I think it's mostly OpenAI specific, not found something similar in Mistral or Anthropic APIs.

2. How often does system_fingerprint change? If its low cardinality enough, I'd suggest adding this to the metric as well as a good way to correlate between fingerprint changes and degradations/changes in app performance.

I don't know

I have two questions:

1. Can we confirm that this is returned from more vendors/models than OpenAI?

I think it's mostly OpenAI specific, not found something similar in Mistral or Anthropic APIs.

2. How often does system_fingerprint change? If its low cardinality enough, I'd suggest adding this to the metric as well as a good way to correlate between fingerprint changes and degradations/changes in app performance.

I don't know

Can you add this to the metric

I have two questions:

1. Can we confirm that this is returned from more vendors/models than OpenAI?

I think it's mostly OpenAI specific, not found something similar in Mistral or Anthropic APIs.

2. How often does system_fingerprint change? If its low cardinality enough, I'd suggest adding this to the metric as well as a good way to correlate between fingerprint changes and degradations/changes in app performance.

I don't know

I think its worth adding this to the base set for metrics as Conditionally Required, If available : https://github.com/open-telemetry/semantic-conventions/blob/main/model/metrics/gen-ai.yaml

If it exists in Mistral and Anthropic, then it makes sense to keep in in the generic namespace vs a vendor namespace.

[lmolkova]

Thanks a lot for following up and adding this @xrmx!

Given that it seems to be OpenAI specific, it'd need to be gen_ai.openai.response.system_fingerprint (or similar) attribute.

But before we can add it, we'd need to add the whole openai specific conventions doc - I created #1370 to track it and it's up for grabs for anyone interested.

[drewby]

@xrmx OpenAI conventions are now merged. Can you rebase and apply your system_fingerprint attribute to the new openai attributes?

#1385

[xrmx]

@drewby @lmolkova I have rebased this, PTAL!

[lmolkova]

Thank you for following up on this one!
LGTM (but will need to regenerate tables once upstream heals)

[nirga]

@xrmx can you rebase? I think it will fix the CI failure

[xrmx]

Rebased and regenerated table