chore(test) openai api type matching / conformance testing

[gerred]

Chore: API Type Matching / OpenAI OpenAPI Conformance Testing

Context:
To ensure compatibility and consistency with the OpenAI API, it is essential to audit the types implemented in our API and verify that they match the types and request/response signatures defined in the OpenAI API. Additionally, we need to develop compliance testing against the official openai-openapi repository to detect any drift or deviations over time.

Tasks:

• Obtain the latest version of the OpenAI OpenAPI specification from the official openai-openapi repository
• Identify all the types and request/response signatures currently implemented in our API
• Compare each type and signature in our API with the corresponding definitions in the OpenAI OpenAPI specification
• Document any discrepancies or deviations found during the comparison
• Update our API codebase to match the types and signatures defined in the OpenAI OpenAPI specification
• Create a nightly workflow of conformance tests that validate our API against the OpenAI OpenAPI specification #986
• Integrate the compliance tests into our CI/CD pipeline to automatically detect any drift or deviations
• Set up automated alerts or notifications when the compliance tests fail, indicating a mismatch with the OpenAI API
• Establish a regular schedule to sync our API with the latest version of the OpenAI OpenAPI specification
• Document the process for updating our API to maintain compatibility with the OpenAI API
• Provide clear instructions for running the compliance tests and interpreting the results
• Regularly review and update the compliance tests as the OpenAI API evolves over time

[alekst23]

Reopening this issue to finish the full scope of conformance testing

[justinthelaw]

Ensure these tests cover the issue found and solved by #1031