JAX port with ByT5 Embeddings #65
Unanswered
contrebande-labs
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Hi guys!
Sorry for x-posting from Instagram but are you planning on releaseing the pre-training code? How hard would it be to port your training pipeline to JAX and use ByT5 instead of T5? We'd love to make a multilingual, character-aware Deep-Floyd IF! Thanks!
Beta Was this translation helpful? Give feedback.
All reactions