causal_lm_cpp

[Continious Batching] Speculative decoding based on paged attention #2005

Sign in to view logs

Triggered via pull request September 6, 2024 17:23

iefode

synchronize #608

iefode:speculative_decoding

Status Failure

Total duration 13m 26s

Billable time 1h 35m

Artifacts –

causal_lm_cpp.yml

on: pull_request

Matrix: cpp-beam_search_causal_lm-ubuntu

cpp-multinomial-greedy_causal_lm-ubuntu

cpp-greedy_causal_lm-windows

cpp-beam_search_causal_lm-Qwen-7B-Chat

cpp-beam_search_causal_lm-Qwen1_5-7B-Chat

cpp-beam_search_causal_lm-Phi-2

cpp-beam_search_causal_lm-notus-7b-v1

cpp-speculative_decoding_lm-ubuntu

cpp-prompt_lookup_decoding_lm-ubuntu

cpp-greedy_causal_lm-redpajama-3b-chat

cpp-chat_sample-ubuntu

cpp-continuous-batching-ubuntu

cpp-continuous-batching-windows

cpp-continuous-batching-macos

ci/gha_overall_status_causal_lm

Annotations

9 errors and 14 warnings

cpp-continuous-batching-macos

Process completed with exit code 2.

cpp-Phi-1_5

Process completed with exit code 1.

cpp-continuous-batching-ubuntu

Process completed with exit code 139.

cpp-greedy_causal_lm-redpajama-3b-chat

Process completed with exit code 1.

cpp-speculative_decoding_lm-ubuntu

Process completed with exit code 1.

cpp-multinomial-greedy_causal_lm-ubuntu

Process completed with exit code 1.

cpp-beam_search_causal_lm-Qwen-7B-Chat

Process completed with exit code 1.

cpp-prompt_lookup_decoding_lm-ubuntu

Process completed with exit code 1.

ci/gha_overall_status_causal_lm

Process completed with exit code 1.

cpp-continuous-batching-macos

The following actions use a deprecated Node.js version and will be forced to run on node20: actions/setup-python@v4. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/

cpp-beam_search_causal_lm-notus-7b-v1

The following actions use a deprecated Node.js version and will be forced to run on node20: actions/setup-python@v4. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/

cpp-Phi-1_5

The following actions use a deprecated Node.js version and will be forced to run on node20: actions/setup-python@v4. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/

cpp-continuous-batching-ubuntu

The following actions use a deprecated Node.js version and will be forced to run on node20: actions/setup-python@v4. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/

cpp-greedy_causal_lm-redpajama-3b-chat

The following actions use a deprecated Node.js version and will be forced to run on node20: actions/setup-python@v4. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/

cpp-beam_search_causal_lm-Phi-2

The following actions use a deprecated Node.js version and will be forced to run on node20: actions/setup-python@v4. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/

cpp-speculative_decoding_lm-ubuntu

The following actions use a deprecated Node.js version and will be forced to run on node20: actions/setup-python@v4. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/

cpp-beam_search_causal_lm-Qwen1_5-7B-Chat

The following actions use a deprecated Node.js version and will be forced to run on node20: actions/setup-python@v4. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/

cpp-multinomial-greedy_causal_lm-ubuntu

The following actions use a deprecated Node.js version and will be forced to run on node20: actions/setup-python@v4. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/

cpp-chat_sample-ubuntu

The following actions use a deprecated Node.js version and will be forced to run on node20: actions/setup-python@v4. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/

cpp-beam_search_causal_lm-Qwen-7B-Chat

The following actions use a deprecated Node.js version and will be forced to run on node20: actions/setup-python@v4. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/

cpp-beam_search_causal_lm-ubuntu (python ./samples/python/beam_search_causal_lm/beam_search_causa...

The following actions use a deprecated Node.js version and will be forced to run on node20: actions/setup-python@v4. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/

cpp-prompt_lookup_decoding_lm-ubuntu

The following actions use a deprecated Node.js version and will be forced to run on node20: actions/setup-python@v4. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/

cpp-beam_search_causal_lm-ubuntu (./build/samples/cpp/beam_search_causal_lm/beam_search_causal_lm)

The following actions use a deprecated Node.js version and will be forced to run on node20: actions/setup-python@v4. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/