new object_detection error from today's commis: 'ManualStepLearningRate' object has no attribute 'warmup' #3705

jwnsu · 2018-03-22T19:42:24Z

After pulled today's changes, got an error in previously working training (warmup was not in config file at all)

Traceback (most recent call last):
  File "object_detection/train.py", line 167, in <module>
    tf.app.run()
  File "/home/dsu/tf/local/lib/python2.7/site-packages/tensorflow/python/platform/app.py", line 126, in run
    _sys.exit(main(argv))
  File "object_detection/train.py", line 163, in main
    worker_job_name, is_chief, FLAGS.train_dir)
  File "/home/dsu/ai/tfmodels/research/object_detection/trainer.py", line 255, in train
    train_config.optimizer)
  File "/home/dsu/ai/tfmodels/research/object_detection/builders/optimizer_builder.py", line 50, in build
    learning_rate = _create_learning_rate(config.learning_rate)
  File "/home/dsu/ai/tfmodels/research/object_detection/builders/optimizer_builder.py", line 109, in _create_learning_rate
    learning_rate_sequence, config.warmup)
AttributeError: 'ManualStepLearningRate' object has no attribute 'warmup'

The text was updated successfully, but these errors were encountered:

learnbott · 2018-03-23T00:17:39Z

I had the same problem, but then realized I need to update my pipeline.config to conform to the new manualsteplearningrate. After I made the adjustments I get this error:

python
Future major versions of TensorFlow will allow gradients to flow
into the labels input on backprop by default.

See tf.nn.softmax_cross_entropy_with_logits_v2.

Traceback (most recent call last):
  File "/usr/local/lib/python3.5/dist-packages/tensorflow/python/framework/op_def_library.py", line 510, in _apply_op_helper
    preferred_dtype=default_dtype)
  File "/usr/local/lib/python3.5/dist-packages/tensorflow/python/framework/ops.py", line 1022, in internal_convert_to_tensor
    ret = conversion_func(value, dtype=dtype, name=name, as_ref=as_ref)
  File "/usr/local/lib/python3.5/dist-packages/tensorflow/python/framework/constant_op.py", line 233, in _constant_tensor_conversion_function
    return constant(v, dtype=dtype, name=name)
  File "/usr/local/lib/python3.5/dist-packages/tensorflow/python/framework/constant_op.py", line 212, in constant
    value, dtype=dtype, shape=shape, verify_shape=verify_shape))
  File "/usr/local/lib/python3.5/dist-packages/tensorflow/python/framework/tensor_util.py", line 422, in make_tensor_proto
    _GetDenseDimensions(values)))
ValueError: Argument must be a dense tensor: range(0, 3) - got shape [3], but wanted [].

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.5/dist-packages/tensorflow/python/framework/op_def_library.py", line 524, in _apply_op_helper
    values, as_ref=input_arg.is_ref).dtype.name
  File "/usr/local/lib/python3.5/dist-packages/tensorflow/python/framework/ops.py", line 1022, in internal_convert_to_tensor
    ret = conversion_func(value, dtype=dtype, name=name, as_ref=as_ref)
  File "/usr/local/lib/python3.5/dist-packages/tensorflow/python/framework/constant_op.py", line 233, in _constant_tensor_conversion_function
    return constant(v, dtype=dtype, name=name)
  File "/usr/local/lib/python3.5/dist-packages/tensorflow/python/framework/constant_op.py", line 212, in constant
    value, dtype=dtype, shape=shape, verify_shape=verify_shape))
  File "/usr/local/lib/python3.5/dist-packages/tensorflow/python/framework/tensor_util.py", line 422, in make_tensor_proto
    _GetDenseDimensions(values)))
ValueError: Argument must be a dense tensor: range(0, 3) - got shape [3], but wanted [].

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/work/repos/models/research/object_detection/train.py", line 167, in <module>
    tf.app.run()
  File "/usr/local/lib/python3.5/dist-packages/tensorflow/python/platform/app.py", line 124, in run
    _sys.exit(main(argv))
  File "/work/repos/models/research/object_detection/train.py", line 163, in main
    worker_job_name, is_chief, FLAGS.train_dir)
  File "/work/repos/models/research/object_detection/trainer.py", line 255, in train
    train_config.optimizer)
  File "/work/repos/models/research/object_detection/builders/optimizer_builder.py", line 58, in build
    learning_rate = _create_learning_rate(config.learning_rate)
  File "/work/repos/models/research/object_detection/builders/optimizer_builder.py", line 109, in _create_learning_rate
    learning_rate_sequence, config.warmup)
  File "/work/repos/models/research/object_detection/utils/learning_schedules.py", line 169, in manual_stepping
    [0] * num_boundaries))
  File "/usr/local/lib/python3.5/dist-packages/tensorflow/python/ops/array_ops.py", line 2540, in where
    return gen_math_ops._select(condition=condition, x=x, y=y, name=name)
  File "/usr/local/lib/python3.5/dist-packages/tensorflow/python/ops/gen_math_ops.py", line 4043, in _select
    "Select", condition=condition, t=x, e=y, name=name)
  File "/usr/local/lib/python3.5/dist-packages/tensorflow/python/framework/op_def_library.py", line 528, in _apply_op_helper
    (input_name, err))
ValueError: Tried to convert 't' to a tensor and failed. Error: Argument must be a dense tensor: range(0, 3) - got shape [3], but wanted [].

VinceKumar · 2018-03-23T00:28:39Z

I get this error too

learnbott · 2018-03-23T07:04:37Z

I believe it is the same Python3 incompatibility that has crept up before (see #3443 ). The issue is with models/research/object_detection/utils/learning_schedules.py lines 167-169. Currently it is

rate_index = tf.reduce_max(tf.where(tf.greater_equal(global_step, boundaries),
                                      range(num_boundaries),
                                      [0] * num_boundaries))

Wrap list() around the range() like this:

rate_index = tf.reduce_max(tf.where(tf.greater_equal(global_step, boundaries),
                                     list(range(num_boundaries)),
                                      [0] * num_boundaries))

and you should be good to go. Mine is off and training.

@jwnsu make sure you change your pipeline.config from:

        manual_step_learning_rate {
          initial_learning_rate: 0.00001
          schedule {
            step: 0
            learning_rate: .0003
          }
          schedule {
            step: 900000
            learning_rate: .00003
          }
          schedule {
            step: 1200000
            learning_rate: .000003
          }
        }
      }
      momentum_optimizer_value: 0.9
    }
    use_moving_average: false
  }

to the new slightly different:

        manual_step_learning_rate {
          initial_learning_rate: 0.0003
          schedule {
            step: 900000
            learning_rate: .00003
          }
          schedule {
            step: 1200000
            learning_rate: .000003
          }
        }
      }
      momentum_optimizer_value: 0.9
    }
    use_moving_average: false
  }

jrabary · 2018-03-23T09:31:45Z

same problem as here #3605

jwnsu · 2018-03-23T15:18:23Z

manual_step_learning_rate is not used directly, seems a new bug, here is the config:

optimizer {
    momentum_optimizer: {
      learning_rate: {
        manual_step_learning_rate {
          initial_learning_rate: 0.0003
          schedule {
            step: 900000
            learning_rate: .0003
          }
          schedule {
            step: 1200000
            learning_rate: .000003
          }
        }
      }
      momentum_optimizer_value: 0.9
    }
    use_moving_average: false

allendoss · 2018-03-23T15:49:23Z

@learnbott I was having the errors you had mentioned before:
ValueError: Argument must be a dense tensor: range(0, 3) - got shape [3], but wanted []
The wraping of list worked for me. Thanks a ton!

jlertle · 2018-03-28T05:35:35Z

remember to recompile protobufs after upgrade:

# From tensorflow/models/research/
protoc object_detection/protos/*.proto --python_out=.

hustc12 · 2018-04-04T02:43:34Z

I meet this issue too, but thanks to @learnbott , and now I can move on.

roy-d · 2018-04-07T19:44:42Z

you rock @learnbott

FalcoGer · 2018-04-12T21:33:47Z

when will this fix be merged?

AliceDinh · 2018-05-10T07:46:50Z

@learnbott
The wraping of list did not work for me at first.
ValueError: Tried to convert 't' to a tensor and failed. Error: Argument must be a dense tensor: range(0, 3) - got shape [3], but wanted [].
but then I run the following commands in my tensorflow path

\models\research> python setup.py build
\models\research> python setup.py install

Then it works

per tensorflow#3705 (comment)

srunitha · 2018-05-28T09:09:47Z

please help me to resolve the issue

(py36_tf_cpu) C:\tensorflow\models\research\object_detection>python train.py --l
ogtostderr --train_dir=training/ --pipeline_config_path=training/faster_rcnn_inc
eption_v2_pets.config
INFO:tensorflow:Scale of 0 disables regularizer.
INFO:tensorflow:Scale of 0 disables regularizer.
INFO:tensorflow:depth of additional conv before box predictor: 0
INFO:tensorflow:Scale of 0 disables regularizer.
Traceback (most recent call last):
File "train.py", line 184, in
tf.app.run()
File "C:\Users\Test\Anaconda3\envs\py36_tf_cpu\lib\site-packages\tensorflow\py
thon\platform\app.py", line 124, in run
_sys.exit(main(argv))
File "train.py", line 180, in main
graph_hook_fn=graph_rewriter_fn)
File "C:\tensorflow\models\research\object_detection\trainer.py", line 288, in
train
train_config.optimizer)
File "C:\tensorflow\models\research\object_detection\builders\optimizer_builde
r.py", line 50, in build
learning_rate = _create_learning_rate(config.learning_rate)
File "C:\tensorflow\models\research\object_detection\builders\optimizer_builde
r.py", line 109, in _create_learning_rate
learning_rate_sequence, config.warmup)
File "C:\tensorflow\models\research\object_detection\utils\learning_schedules.
py", line 156, in manual_stepping
raise ValueError('First step cannot be zero.')
ValueError: First step cannot be zero.

Deepshikhasinha · 2018-06-01T20:20:59Z

The wrapping did now work for me. I also tried what AliceDinh Suggested. But it is still giving me the same error.

NatheesanSelvaratnam · 2018-06-14T05:36:39Z

@srunitha same here did u find the solution
Future major versions of TensorFlow will allow gradients to flow
into the labels input on backprop by default.

See @{tf.nn.softmax_cross_entropy_with_logits_v2}.

Traceback (most recent call last):
File "train.py", line 184, in
tf.app.run()
File "C:\Users\JLANKA_PC\Anaconda3\lib\site-packages\tensorflow\python\platform\app.py", line 126, in run
_sys.exit(main(argv))
File "train.py", line 180, in main
graph_hook_fn=graph_rewriter_fn)
File "C:\tensorflow1\models\research\object_detection\trainer.py", line 298, in train
train_config.optimizer)
File "C:\tensorflow1\models\research\object_detection\builders\optimizer_builder.py", line 50, in build
learning_rate = _create_learning_rate(config.learning_rate)
File "C:\tensorflow1\models\research\object_detection\builders\optimizer_builder.py", line 109, in _create_learning_rate
learning_rate_sequence, config.warmup)
File "C:\tensorflow1\models\research\object_detection\utils\learning_schedules.py", line 156, in manual_stepping
raise ValueError('First step cannot be zero.')
ValueError: First step cannot be zero.

alouisos · 2018-06-18T15:26:43Z

list wrapping and python setup build and install worked for me

xro7 · 2018-07-20T13:28:24Z

@learnbott solution didn't work for me.
I changed range(num_boundaries) to [i for i in range(num_boundaries)] in \models\research\object_detection\utils\learning_schedules.py
Then:
\models\research> python setup.py build
\models\research> python setup.py install
and worked

Shubhamrock428 · 2018-10-08T11:56:01Z

how can i solve this error?
raceback (most recent call last):
File "export_inference_graph.py", line 150, in
tf.app.run()
File "C:\Users\DELL LAPTOP\Miniconda3\envs\tfp3.6\lib\site-packages\tensorflow\python\platform\app.py", line 125, in run
_sys.exit(main(argv))
File "export_inference_graph.py", line 146, in main
write_inference_graph=FLAGS.write_inference_graph)
File "C:\Users\DELL LAPTOP\Miniconda3\envs\tfp3.6\lib\site-packages\object_detection-0.1-py3.6.egg\object_detection\exporter.py", line 389, in export_inference_graph
is_training=False)
File "C:\Users\DELL LAPTOP\Miniconda3\envs\tfp3.6\lib\site-packages\object_detection-0.1-py3.6.egg\object_detection\builders\model_builder.py", line 121, in build
raise ValueError('Unknown meta architecture: {}'.format(meta_architecture))
ValueError: Unknown meta architecture: None

mitarthjain · 2018-12-08T14:03:11Z

ImportError Traceback (most recent call last)
in
10 from collections import defaultdict
11 from io import StringIO
---> 12 from matplotlib import pyplot as plt
13 from PIL import Image
14

~\AppData\Roaming\Python\Python36\site-packages\matplotlib\pyplot.py in
30 from cycler import cycler
31 import matplotlib
---> 32 import matplotlib.colorbar
33 import matplotlib.image
34 from matplotlib import rcsetup, style

~\AppData\Roaming\Python\Python36\site-packages\matplotlib\colorbar.py in
26
27 import matplotlib as mpl
---> 28 import matplotlib.artist as martist
29 import matplotlib.cbook as cbook
30 import matplotlib.collections as collections

~\AppData\Roaming\Python\Python36\site-packages\matplotlib\artist.py in
9 import matplotlib
10 from . import cbook, docstring, rcParams
---> 11 from .path import Path
12 from .transforms import (Bbox, IdentityTransform, Transform, TransformedBbox,
13 TransformedPatchPath, TransformedPath)

~\AppData\Roaming\Python\Python36\site-packages\matplotlib\path.py in
15 import numpy as np
16
---> 17 from . import _path, rcParams
18 from .cbook import _to_unmasked_float_array, simple_linear_interpolation
19

ImportError: cannot import name '_path'
how to solve this error?

mitarthjain · 2018-12-08T14:03:57Z

in the last section of code:-
NameError Traceback (most recent call last)
in
1 for image_path in TEST_IMAGE_PATHS:
----> 2 image = Image.open(image_path)
3 # the array based representation of the image will be used later in order to prepare the
4 # result image with boxes and labels on it.
5 image_np = load_image_into_numpy_array(image)

NameError: name 'Image' is not defined
How to solve this one??

…375563179, use list(range(...)) rather than range(...) for Python 3

yadnyeshn · 2019-02-03T15:50:53Z

While executing the train.py file i get the following error:
Traceback (most recent call last):
File "train.py", line 49, in
from object_detection.builders import dataset_builder
ImportError: No module named 'object_detection'
Please help I'm new to this

jamesdoom22 · 2019-03-01T05:35:19Z

Where do i need to change some line codes about boxes because i'm planning to set color green if the accuracy >=98 then red if not. i'm using real-time :D

msdhina · 2019-03-29T10:02:20Z

Though running successfully the jupyter notebook, the output images is not displaying. anywhere I gone wrng? PLSS HELP!! :)

InspirationLaurie · 2019-06-01T08:22:22Z

@yadnyeshn It‘s easy~ Confirm your pythonpath is added again~

qiu-pinggaizi · 2019-07-01T11:22:33Z

After pulled today's changes, got an error in previously working training (warmup was not in config file at all)

Traceback (most recent call last):
  File "object_detection/train.py", line 167, in <module>
    tf.app.run()
  File "/home/dsu/tf/local/lib/python2.7/site-packages/tensorflow/python/platform/app.py", line 126, in run
    _sys.exit(main(argv))
  File "object_detection/train.py", line 163, in main
    worker_job_name, is_chief, FLAGS.train_dir)
  File "/home/dsu/ai/tfmodels/research/object_detection/trainer.py", line 255, in train
    train_config.optimizer)
  File "/home/dsu/ai/tfmodels/research/object_detection/builders/optimizer_builder.py", line 50, in build
    learning_rate = _create_learning_rate(config.learning_rate)
  File "/home/dsu/ai/tfmodels/research/object_detection/builders/optimizer_builder.py", line 109, in _create_learning_rate
    learning_rate_sequence, config.warmup)
AttributeError: 'ManualStepLearningRate' object has no attribute 'warmup'

from nets import inception_resnet_v2
ModuleNotFoundError: No module named 'nets'
how to solve this problem

jwnsu changed the title ~~object_detection error: 'ManualStepLearningRate' object has no attribute 'warmup'~~ new object_detection error: 'ManualStepLearningRate' object has no attribute 'warmup' Mar 22, 2018

jwnsu changed the title ~~new object_detection error: 'ManualStepLearningRate' object has no attribute 'warmup'~~ new object_detection error from today's commis: 'ManualStepLearningRate' object has no attribute 'warmup' Mar 22, 2018

lcerman mentioned this issue Mar 27, 2018

ValueError: Tried to convert 't' to a tensor and failed. Error: Argument must be a dense tensor: range(0, 3) - got shape [3], but wanted []. #3752

Closed

jwnsu closed this as completed Apr 7, 2018

Lanbig mentioned this issue Apr 12, 2018

obj detection training with faster_rcnn_inception_v2_coco Argument must be a dense tensor: range(0, 3) - got shape [3], but wanted []. #3948

Closed

VinceKumar mentioned this issue Apr 19, 2018

OutOfRangeError (see above for traceback): #4032

Closed

italojs mentioned this issue May 3, 2018

ValueError: Tried to convert 't' to a tensor and failed. Error: Argument must be a dense tensor: range(0, 3) - got shape [3], but wanted []. EdjeElectronics/TensorFlow-Object-Detection-API-Tutorial-Train-Multiple-Objects-Windows-10#11

Closed

rahullahoria mentioned this issue May 15, 2018

Cannot start training my models because of this errors #4262

Closed

xiaoyongzhu added a commit to xiaoyongzhu/models that referenced this issue May 18, 2018

Update learning_schedules.py

59758f1

per tensorflow#3705 (comment)

shubhajitml mentioned this issue May 27, 2018

module 'tensorflow.contrib.data' has no attribute 'parallel_interleave' EdjeElectronics/TensorFlow-Object-Detection-API-Tutorial-Train-Multiple-Objects-Windows-10#48

Open

peterroelants mentioned this issue May 30, 2018

Explicitly cast range function to list or tuple for Python 3 compatibility. #4408

Closed

vinceyang mentioned this issue Jun 26, 2018

Error during Running the training EdjeElectronics/TensorFlow-Object-Detection-API-Tutorial-Train-Multiple-Objects-Windows-10#76

Closed

harshilpatel312 mentioned this issue Jun 29, 2018

ValueError: Tried to convert 't' to a tensor and failed. #4655

Closed

apriandito mentioned this issue Aug 5, 2018

Key Conv/biases not found in checkpoint in Resnet 101 #5003

Closed

mrquincle referenced this issue in mrquincle/latent_3d_points Jan 17, 2019

Issue https://github.com/tensorflow/models/issues/3705\#issuecomment-…

531b3f0

…375563179, use list(range(...)) rather than range(...) for Python 3

maxorange mentioned this issue Mar 13, 2019

ValueError problem maxorange/voxel-dcgan#4

Open

Saduf2019 mentioned this issue Mar 3, 2020

ValueError: Tried to convert 'y' to a tensor and failed. Error: None values not supported. tensorflow/tensorflow#36140

Closed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

new object_detection error from today's commis: 'ManualStepLearningRate' object has no attribute 'warmup' #3705

new object_detection error from today's commis: 'ManualStepLearningRate' object has no attribute 'warmup' #3705

jwnsu commented Mar 22, 2018 •

edited

Loading

learnbott commented Mar 23, 2018

VinceKumar commented Mar 23, 2018

learnbott commented Mar 23, 2018

jrabary commented Mar 23, 2018

jwnsu commented Mar 23, 2018

allendoss commented Mar 23, 2018

jlertle commented Mar 28, 2018

hustc12 commented Apr 4, 2018

roy-d commented Apr 7, 2018

FalcoGer commented Apr 12, 2018

AliceDinh commented May 10, 2018 •

edited

Loading

srunitha commented May 28, 2018

Deepshikhasinha commented Jun 1, 2018

NatheesanSelvaratnam commented Jun 14, 2018

alouisos commented Jun 18, 2018

xro7 commented Jul 20, 2018 •

edited

Loading

Shubhamrock428 commented Oct 8, 2018

mitarthjain commented Dec 8, 2018

mitarthjain commented Dec 8, 2018

yadnyeshn commented Feb 3, 2019

jamesdoom22 commented Mar 1, 2019

msdhina commented Mar 29, 2019

InspirationLaurie commented Jun 1, 2019

qiu-pinggaizi commented Jul 1, 2019

new object_detection error from today's commis: 'ManualStepLearningRate' object has no attribute 'warmup' #3705

new object_detection error from today's commis: 'ManualStepLearningRate' object has no attribute 'warmup' #3705

Comments

jwnsu commented Mar 22, 2018 • edited Loading

learnbott commented Mar 23, 2018

VinceKumar commented Mar 23, 2018

learnbott commented Mar 23, 2018

jrabary commented Mar 23, 2018

jwnsu commented Mar 23, 2018

allendoss commented Mar 23, 2018

jlertle commented Mar 28, 2018

hustc12 commented Apr 4, 2018

roy-d commented Apr 7, 2018

FalcoGer commented Apr 12, 2018

AliceDinh commented May 10, 2018 • edited Loading

srunitha commented May 28, 2018

Deepshikhasinha commented Jun 1, 2018

NatheesanSelvaratnam commented Jun 14, 2018

alouisos commented Jun 18, 2018

xro7 commented Jul 20, 2018 • edited Loading

Shubhamrock428 commented Oct 8, 2018

mitarthjain commented Dec 8, 2018

mitarthjain commented Dec 8, 2018

yadnyeshn commented Feb 3, 2019

jamesdoom22 commented Mar 1, 2019

msdhina commented Mar 29, 2019

InspirationLaurie commented Jun 1, 2019

qiu-pinggaizi commented Jul 1, 2019

jwnsu commented Mar 22, 2018 •

edited

Loading

AliceDinh commented May 10, 2018 •

edited

Loading

xro7 commented Jul 20, 2018 •

edited

Loading