Skip to content

Commit

Permalink
Update src/cpp/src/sampler.hpp
Browse files Browse the repository at this point in the history
  • Loading branch information
mzegla authored Aug 2, 2024
1 parent 5b3c185 commit 14c7fa6
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion src/cpp/src/sampler.hpp
Original file line number Diff line number Diff line change
Expand Up @@ -434,7 +434,7 @@ void GroupBeamSearcher::select_next_tokens(const ov::Tensor& logits, SamplerOutp
Sequence::Ptr forked_sequence = m_sequence_group->fork_sequence(candidate.m_sequence);
// and finish immidiately
forked_sequence->set_status(SequenceStatus::FINISHED);
// Setting length since this function is used when sequence generated eos token
// Setting stop since this function is used when sequence generated eos token
forked_sequence->set_finish_reason(GenerationFinishReason::STOP);

// TODO: make it more simplier
Expand Down

0 comments on commit 14c7fa6

Please sign in to comment.