char-embeddings is a repository by Max Woolf containing 300D character embeddings derived from the GloVe 840B/300D dataset, and uses these embeddings to train a deep learning model to generate text using Keras. The generation and model construction is heavily modified after the automatic text generation Keras example by François Chollet.
This repository takes this work, replaces references to specific input files with variables, and refactors it to run as a trainer on Google's ML Engine with a GPU instance.
Follow Google's quickstart guides to get your ML Engine up and running. Ensure you can successfully run a training job before continuing here!
You can run the trainer locally with:
gcloud ml-engine local train --module-name trainer.text_generator_keras --package-path ./trainer -- --train-file=input.txt --job-dir=tmp
Once you have this working correctly, proceed to upload your training text (input.txt) to Google Storage. Then, copy the gcloud.remote.run.sh.example and change the exports to point to your bucket, region, training file etc. Execute your script, and you should see a job appear on ML Engine, with data created in your bucket as iterations complete!
keras, tensorflow, h5py, scikit-learn, gcloud
MIT