Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Failing test: Chrome X-Pack UI Functional Tests.x-pack/test/functional_gen_ai/inference/tests/index·ts - Inference plugin - API integration tests Connector gemini-1-5-pro chatComplete API streaming disabled returns token counts #203205

Closed
kibanamachine opened this issue Dec 6, 2024 · 18 comments · Fixed by #203369
Closed

Failing test: Chrome X-Pack UI Functional Tests.x-pack/test/functional_gen_ai/inference/tests/index·ts - Inference plugin - API integration tests Connector gemini-1-5-pro chatComplete API streaming disabled returns token counts #203205

kibanamachine opened this issue Dec 6, 2024 · 18 comments · Fixed by #203369
Labels
failed-test A test failure on a tracked branch, potentially flaky-test Team:AI Infra AppEx AI Infrastructure Team

Comments

@kibanamachine
Copy link
Contributor

kibanamachine commented Dec 6, 2024 •
edited
Loading

A test failed on a tracked branch

Error: expected undefined to be above 0
    at Assertion.assert (expect.js:100:11)
    at Assertion.apply (expect.js:317:8)
    at Function.greaterThan (expect.js:531:15)
    at Context.<anonymous> (chat_complete.ts:124:37)
    at processTicksAndRejections (node:internal/process/task_queues:95:5)
    at Object.apply (wrap_function.js:74:16)

First failure: kibana-on-merge - main
@kibanamachine kibanamachine added the failed-test A test failure on a tracked branch, potentially flaky-test label Dec 6, 2024
@botelastic botelastic bot added the needs-team Issues missing a team label label Dec 6, 2024
@kibanamachine kibanamachine added the Team:AI Infra AppEx AI Infrastructure Team label Dec 6, 2024
@elasticmachine
Copy link
Contributor

Pinging @elastic/appex-ai-infra (Team:AI Infra)

@botelastic botelastic bot removed the needs-team Issues missing a team label label Dec 6, 2024
@kibanamachine
Copy link
Contributor Author

New failure: kibana-on-merge - main

@kibanamachine
Copy link
Contributor Author

New failure: kibana-on-merge - main

@kibanamachine
Copy link
Contributor Author

New failure: kibana-on-merge - main

@kibanamachine
Copy link
Contributor Author

New failure: kibana-on-merge - main

@kibanamachine
Copy link
Contributor Author

New failure: kibana-on-merge - main

@kibanamachine
Copy link
Contributor Author

New failure: kibana-on-merge - 8.x

@kibanamachine
Copy link
Contributor Author

New failure: kibana-on-merge - main

@kibanamachine
Copy link
Contributor Author

New failure: kibana-on-merge - 8.x

@kibanamachine
Copy link
Contributor Author

New failure: kibana-on-merge - main

@kibanamachine
Copy link
Contributor Author

New failure: kibana-on-merge - main

@delanni
Copy link
Contributor

delanni commented Dec 6, 2024

/skip

kibanamachine added a commit that referenced this issue Dec 6, 2024
@kibanamachine
skip failing test suite (#203205)
1ae6e2c
kibanamachine added a commit that referenced this issue Dec 6, 2024
@kibanamachine
skip failing test suite (#203205)
f702a07
@kibanamachine
Copy link
Contributor Author

Skipped

main: 1ae6e2c
8.x: f702a07

@kibanamachine
Copy link
Contributor Author

New failure: kibana-on-merge - main

@kibanamachine
Copy link
Contributor Author

New failure: kibana-on-merge - 8.x

@kibanamachine
Copy link
Contributor Author

New failure: kibana-on-merge - 8.x

@kibanamachine
Copy link
Contributor Author

New failure: kibana-on-merge - main

@kibanamachine
Copy link
Contributor Author

New failure: kibana-on-merge - main

markov00 pushed a commit to markov00/kibana that referenced this issue Dec 7, 2024
@kibanamachine @markov00
skip failing test suite (elastic#203205)
e4602d2
SoniaSanzV pushed a commit to SoniaSanzV/kibana that referenced this issue Dec 9, 2024
@kibanamachine @SoniaSanzV
skip failing test suite (elastic#203205)
99e61a8
SoniaSanzV pushed a commit to SoniaSanzV/kibana that referenced this issue Dec 9, 2024
@kibanamachine @SoniaSanzV
skip failing test suite (elastic#203205)
eaeaadc
@pgayvallet pgayvallet mentioned this issue Dec 9, 2024
Merged
pgayvallet added a commit to pgayvallet/kibana that referenced this issue Dec 9, 2024
@pgayvallet
GenAI FTR tests: switch to daily job (elastic#203369)
fa30b5e 
## Summary

Part of elastic/kibana-team#1271
Follow-up of elastic#198000

Fix elastic#203205
Fix elastic#203062

- Fix the problem with the Gemini token count events
- Unskip the test suite
- Remove the suite from the `on-merge` pipeline
- Add a dedicated pipeline to run the tests daily

(cherry picked from commit 1f2a76a)

# Conflicts:
#	.buildkite/pipeline-resource-definitions/locations.yml
#	.buildkite/pipelines/on_merge.yml
CAWilson94 pushed a commit to CAWilson94/kibana that referenced this issue Dec 9, 2024
@kibanamachine @CAWilson94
skip failing test suite (elastic#203205)
c18ad80
CAWilson94 pushed a commit to CAWilson94/kibana that referenced this issue Dec 9, 2024
@pgayvallet @CAWilson94
GenAI FTR tests: switch to daily job (elastic#203369)
e9454b4 
## Summary

Part of elastic/kibana-team#1271
Follow-up of elastic#198000

Fix elastic#203205
Fix elastic#203062

- Fix the problem with the Gemini token count events 
- Unskip the test suite
- Remove the suite from the `on-merge` pipeline
- Add a dedicated pipeline to run the tests daily
Samiul-TheSoccerFan pushed a commit to Samiul-TheSoccerFan/kibana that referenced this issue Dec 10, 2024
@kibanamachine @Samiul-TheSoccerFan
skip failing test suite (elastic#203205)
81e0596
Samiul-TheSoccerFan pushed a commit to Samiul-TheSoccerFan/kibana that referenced this issue Dec 10, 2024
@pgayvallet @Samiul-TheSoccerFan
GenAI FTR tests: switch to daily job (elastic#203369)
9da8243 
## Summary

Part of elastic/kibana-team#1271
Follow-up of elastic#198000

Fix elastic#203205
Fix elastic#203062

- Fix the problem with the Gemini token count events 
- Unskip the test suite
- Remove the suite from the `on-merge` pipeline
- Add a dedicated pipeline to run the tests daily
mykolaharmash pushed a commit to mykolaharmash/kibana that referenced this issue Dec 11, 2024
@kibanamachine @mykolaharmash
skip failing test suite (elastic#203205)
d3e5a9d
CAWilson94 pushed a commit to CAWilson94/kibana that referenced this issue Dec 12, 2024
@kibanamachine @CAWilson94
skip failing test suite (elastic#203205)
7cb35dd
CAWilson94 pushed a commit to CAWilson94/kibana that referenced this issue Dec 12, 2024
@pgayvallet @CAWilson94
GenAI FTR tests: switch to daily job (elastic#203369)
b9e299c 
## Summary

Part of elastic/kibana-team#1271
Follow-up of elastic#198000

Fix elastic#203205
Fix elastic#203062

- Fix the problem with the Gemini token count events 
- Unskip the test suite
- Remove the suite from the `on-merge` pipeline
- Add a dedicated pipeline to run the tests daily
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
failed-test A test failure on a tracked branch, potentially flaky-test Team:AI Infra AppEx AI Infrastructure Team
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

GenAI FTR tests: switch to daily job pgayvallet/kibana
3 participants
@delanni @elasticmachine @kibanamachine