causal_lm_cpp

Prefix caching. #1541

Sign in to view logs

Triggered via pull request July 24, 2024 13:17

popovaan

synchronize #675

popovaan:prefix_caching_2024_3

Status Success

Total duration 20m 26s

Billable time 1h 34m

Artifacts –

causal_lm_cpp.yml

on: pull_request

cpp-multinomial-greedy_causal_lm-ubuntu

cpp-greedy_causal_lm-windows

cpp-beam_search_causal_lm-Qwen-7B-Chat

cpp-beam_search_causal_lm-Qwen1_5-7B-Chat

cpp-beam_search_causal_lm-Phi-2

cpp-beam_search_causal_lm-notus-7b-v1

cpp-speculative_decoding_lm-ubuntu

cpp-prompt_lookup_decoding_lm-ubuntu

cpp-greedy_causal_lm-redpajama-3b-chat

cpp-chat_sample-ubuntu

cpp-continuous-batching-ubuntu

cpp-continuous-batching-windows

cpp-continuous-batching-macos

Matrix: cpp-beam_search_causal_lm-ubuntu

Annotations

16 warnings

cpp-beam_search_causal_lm-Phi-2

The following actions uses Node.js version which is deprecated and will be forced to run on node20: actions/setup-python@v4. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/

cpp-beam_search_causal_lm-notus-7b-v1

The following actions uses Node.js version which is deprecated and will be forced to run on node20: actions/setup-python@v4. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/

cpp-prompt_lookup_decoding_lm-ubuntu

The following actions uses Node.js version which is deprecated and will be forced to run on node20: actions/setup-python@v4. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/

cpp-multinomial-greedy_causal_lm-ubuntu

The following actions uses Node.js version which is deprecated and will be forced to run on node20: actions/setup-python@v4. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/

cpp-beam_search_causal_lm-Qwen1_5-7B-Chat

The following actions uses Node.js version which is deprecated and will be forced to run on node20: actions/setup-python@v4. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/

cpp-Phi-1_5

The following actions uses Node.js version which is deprecated and will be forced to run on node20: actions/setup-python@v4. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/

cpp-chat_sample-ubuntu

The following actions uses Node.js version which is deprecated and will be forced to run on node20: actions/setup-python@v4. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/

cpp-beam_search_causal_lm-Qwen-7B-Chat

The following actions uses Node.js version which is deprecated and will be forced to run on node20: actions/setup-python@v4. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/

cpp-beam_search_causal_lm-ubuntu (python ./samples/python/beam_search_causal_lm/beam_search_causa...

The following actions uses Node.js version which is deprecated and will be forced to run on node20: actions/setup-python@v4. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/

cpp-continuous-batching-ubuntu

The following actions uses Node.js version which is deprecated and will be forced to run on node20: actions/setup-python@v4. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/

cpp-greedy_causal_lm-redpajama-3b-chat

The following actions uses Node.js version which is deprecated and will be forced to run on node20: actions/setup-python@v4. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/

cpp-speculative_decoding_lm-ubuntu

The following actions uses Node.js version which is deprecated and will be forced to run on node20: actions/setup-python@v4. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/

cpp-beam_search_causal_lm-ubuntu (./build/samples/cpp/beam_search_causal_lm/beam_search_causal_lm)

The following actions uses Node.js version which is deprecated and will be forced to run on node20: actions/setup-python@v4. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/

cpp-continuous-batching-macos

The following actions uses Node.js version which is deprecated and will be forced to run on node20: actions/setup-python@v4. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/

cpp-greedy_causal_lm-windows

The following actions uses Node.js version which is deprecated and will be forced to run on node20: actions/setup-python@v4. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/

cpp-continuous-batching-windows

The following actions uses Node.js version which is deprecated and will be forced to run on node20: actions/setup-python@v4. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/