You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
This intentionally avoid the rwkv python inference project, as it is meant to be usable for testing/debugging architecture changes (which we may not port over to the inference project). While being terrible unoptimized (its ok!)
Ideally we should have options to run only subset of the evals, so we can "fan out the eval runs" across multiple nodes if needed via github CI down the line.
The text was updated successfully, but these errors were encountered:
RWKV-infctx-trainer uses its own inference code within its own codebase here:
This intentionally avoid the rwkv python inference project, as it is meant to be usable for testing/debugging architecture changes (which we may not port over to the inference project). While being terrible unoptimized (its ok!)
For example in rwkv-x-playground branch : https://github.com/RWKV/RWKV-infctx-trainer/tree/rwkv-x-playground
Every single v5XYZ is an experiment, some which will be abandoned.
What we need is to integrate this for evals, as such the following is recommended
Ideally we should have options to run only subset of the evals, so we can "fan out the eval runs" across multiple nodes if needed via github CI down the line.
The text was updated successfully, but these errors were encountered: