You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
# See Section 3.1. of the paper.# FIXME: to be configured in config not hardecoded. Fix in separate PR with rest of configmax_length=128# TPU supports only lengths multiple of 128
The main problem here is that, assumed I have a previous prompt, and I want to "expand" or rewrite it using the suggested style/prompt engineering guidelines, this will break the 128 tokens limit - most of the time.
When using detailed prompts (as suggested by the good prompt engineering guidelines) it may happen that the prompt gets truncated:
The text was updated successfully, but these errors were encountered: