update code requirements, fix train.py

[jorgeorpinel]

From iterative/dvc.org#762 (comment)

Req's are pretty old:

example-versioning/requirements.txt

Lines 1 to 3 in ac7473d

	tensorflow==1.11.0
	keras==2.2.4
	pillow==5.3.0

(but work. Last tested on Python 3.7)

UPDATE: Actually it's tensorflow==1.13.1 now, see #3 (comment).

---

Update https://dvc.org/doc/tutorials/versioning accordingly if this code changes.

[jorgeorpinel]

@shcheklein said (in iterative/dvc.org#762 (comment)):

I think it's bette to review it and update either using PyTorch or the latest release TensorFlow + Keras.

[jorgeorpinel]

p.s. sorry I was mistaken actually its tensorflow==1.13.1 now (1.11.0 is no longer available with pip) and also test.py is broken with:

Traceback (most recent call last):
  File "train.py", line 123, in <module>
    train_top_model()
  File "train.py", line 118, in train_top_model
    json.dump(history.history, open("metrics.json", 'w'))
...
  File "/.../lib/python3.7/json/encoder.py", line 179, in default
    raise TypeError(f'Object of type {o.__class__.__name__} '
TypeError: Object of type float32 is not JSON serializable

[jorgeorpinel]

Still interested given this ^ @casperdcl?

[casperdcl]

yes easy fix just don't have much time over the next week or so

[jorgeorpinel]

OK great, please self-assign when you have the time if this is still open. 🙂

[jorgeorpinel]

Actually this is kind of a high priority I would say don't you think @shcheklein? Since basically our versioning tutorial is broken because of this.

Can someone from @iterative/engineering take a look? I was able to run train.py successfully by accident at some point but I'm not sure which versions of what I was using.

p.s. Preferably someone with a GPU because testing this takes a while on regular computers.

[casperdcl]

ah fine... there are a few other minor issues too. Will PR soon.

[casperdcl]

ok see #5... btw I used tensorflow==2 and it takes less than 10 secs on my computer. We'd have to write tensorflow-gpu==2 in requirements.txt for a GPU version.

[jorgeorpinel]

Thanks @casperdcl didn't mean to turn on the pressure! Just need to get this resolved soon by our team. Your contribution is greatly appreciated! Checking your PR... (will take some time to run on my MacBook air...)

[shcheklein]

@jorgeorpinel @casperdcl I would avoid GPU - it can complicate installation. It should be quick enough when you run it even on CPU since model is pre-trained as far as I remember.

[casperdcl]

yes AFAIK best practice is (seemingly as with dvc in this case) is to leave tensorflow out of requirements.txt completely and write in the docs that people need to install it themselves (so they can choose their own flavour).

[shcheklein]

@casperdcl true. in this case I decided to specify it anyway since it's a simple example and we use virtualenv to completely isolate it Just for the sake of simplicity.

[jorgeorpinel]

I would avoid GPU...

@shcheklein I just meant that train.py is not very fast. It's not super slow either but it takes around 10 min to run on my MacBook Air (when/if it works).

[casperdcl]

10 min? On my 12 core (48 with hyperthreading) machine with many background tasks running I still get under 10 secs. My guess is I/O rather than CPU is your main bottleneck?

[jorgeorpinel]

I'm on a 2015 MacBook Air so maybe that explains it. But yeah maybe I/O. Who knows these things haha