Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

python 3.9 + dask incompatibility w/o extra import #74

Open
johnwlambert opened this issue Jan 10, 2021 · 2 comments
Open

python 3.9 + dask incompatibility w/o extra import #74

johnwlambert opened this issue Jan 10, 2021 · 2 comments
Labels
bug Something isn't working

Comments

@johnwlambert
Copy link
Collaborator

python 3.9 incompatibility with dask requires additional import ordering

dask/distributed#4168
@johnwlambert
Copy link
Collaborator Author

also in 3.9 on mac , not present in 3.8 on linux:

TypeError: unsupported operand type(s) for -: 'float' and 'NoneType'
tornado.application - ERROR - Exception in callback functools.partial(<bound method IOLoop._discard_future_result of <tornado.platform.asyncio.AsyncIOLoop object at 0x10d7d3b20>>, <Task finished name='Task-2020' coro=<Worker.heartbeat() done, defined at /Users/johnlambert/anaconda3/envs/gtsfm-v5/lib/python3.9/site-packages/distributed/worker.py:929> exception=TypeError("unsupported operand type(s) for -: 'float' and 'NoneType'")>)
Traceback (most recent call last):

@johnwlambert johnwlambert mentioned this issue Jan 10, 2021
Merged
@johnwlambert
Copy link
Collaborator Author 

AttributeError: 'gtsam.gtsam.SfmData' object has no attribute 'serialize'
Traceback (most recent call last):
  File "/nethome/jlambert30/miniconda3/envs/gtsfm-v7/lib/python3.9/site-packages/distributed/utils.py", line 655, in log_errors
    yield
  File "/nethome/jlambert30/miniconda3/envs/gtsfm-v7/lib/python3.9/site-packages/distributed/worker.py", line 2032, in gather_dep
    response = await get_data_from_worker(
  File "/nethome/jlambert30/miniconda3/envs/gtsfm-v7/lib/python3.9/site-packages/distributed/worker.py", line 3269, in get_data_from_worker
    return await retry_operation(_get_data, operation="get_data_from_worker")
  File "/nethome/jlambert30/miniconda3/envs/gtsfm-v7/lib/python3.9/site-packages/distributed/utils_comm.py", line 384, in retry_operation
    return await retry(
  File "/nethome/jlambert30/miniconda3/envs/gtsfm-v7/lib/python3.9/site-packages/distributed/utils_comm.py", line 369, in retry
    return await coro()
  File "/nethome/jlambert30/miniconda3/envs/gtsfm-v7/lib/python3.9/site-packages/distributed/worker.py", line 3249, in _get_data
    response = await send_recv(
  File "/nethome/jlambert30/miniconda3/envs/gtsfm-v7/lib/python3.9/site-packages/distributed/core.py", line 661, in send_recv
    response = await comm.read(deserializers=deserializers)
  File "/nethome/jlambert30/miniconda3/envs/gtsfm-v7/lib/python3.9/site-packages/distributed/comm/tcp.py", line 212, in read
    msg = await from_frames(
  File "/nethome/jlambert30/miniconda3/envs/gtsfm-v7/lib/python3.9/site-packages/distributed/comm/utils.py", line 80, in from_frames
    res = _from_frames()
  File "/nethome/jlambert30/miniconda3/envs/gtsfm-v7/lib/python3.9/site-packages/distributed/comm/utils.py", line 63, in _from_frames
    return protocol.loads(
  File "/nethome/jlambert30/miniconda3/envs/gtsfm-v7/lib/python3.9/site-packages/distributed/protocol/core.py", line 151, in loads
    value = _deserialize(head, fs, deserializers=deserializers)
  File "/nethome/jlambert30/miniconda3/envs/gtsfm-v7/lib/python3.9/site-packages/distributed/protocol/serialize.py", line 374, in deserialize
    return loads(header, frames)
  File "/nethome/jlambert30/miniconda3/envs/gtsfm-v7/lib/python3.9/site-packages/distributed/protocol/serialize.py", line 154, in serialization_error_loads
    raise TypeError(msg)
TypeError: Could not serialize object of type SfmData.
Traceback (most recent call last):
  File "/nethome/jlambert30/miniconda3/envs/gtsfm-v7/lib/python3.9/site-packages/distributed/protocol/serialize.py", line 297, in serialize
    header, frames = dumps(x, context=context) if wants_context else dumps(x)
  File "/nethome/jlambert30/miniconda3/envs/gtsfm-v7/lib/python3.9/site-packages/distributed/protocol/serialize.py", line 42, in dask_dumps
    header, frames = dumps(x)
  File "/nethome/jlambert30/gtsfm/gtsfm/utils/serialization.py", line 232, in serialize_SfmData
    frames = [bytes(obj.serialize(), "utf-8")]
AttributeError: 'gtsam.gtsam.SfmData' object has no attribute 'serialize'

tornado.application - ERROR - Exception in callback functools.partial(<bound method IOLoop._discard_future_result of <tornado.platform.asyncio.AsyncIOLoop object at 0x7f00c80fb7c0>>, <Task finished name='Task-7792' coro=<Worker.gather_dep() done, defined at /nethome/jlambert30/miniconda3/envs/gtsfm-v7/lib/python3.9/site-packages/distributed/worker.py:2000> exception=TypeError('Could not serialize object of type SfmData.\nTraceback (most recent call last):\n  File "/nethome/jlambert30/miniconda3/envs/gtsfm-v7/lib/python3.9/site-packages/distributed/protocol/serialize.py", line 297, in serialize\n    header, frames = dumps(x, context=context) if wants_context else dumps(x)\n  File "/nethome/jlambert30/miniconda3/envs/gtsfm-v7/lib/python3.9/site-packages/distributed/protocol/serialize.py", line 42, in dask_dumps\n    header, frames = dumps(x)\n  File "/nethome/jlambert30/gtsfm/gtsfm/utils/serialization.py", line 232, in serialize_SfmData\n    frames = [bytes(obj.serialize(), "utf-8")]\nAttributeError: \'gtsam.gtsam.SfmData\' object has no attribute \'serialize\'\n')>)
Traceback (most recent call last):
  File "/nethome/jlambert30/miniconda3/envs/gtsfm-v7/lib/python3.9/site-packages/tornado/ioloop.py", line 741, in _run_callback
    ret = callback()
  File "/nethome/jlambert30/miniconda3/envs/gtsfm-v7/lib/python3.9/site-packages/tornado/ioloop.py", line 765, in _discard_future_result
    future.result()
  File "/nethome/jlambert30/miniconda3/envs/gtsfm-v7/lib/python3.9/site-packages/distributed/worker.py", line 2032, in gather_dep
    response = await get_data_from_worker(
  File "/nethome/jlambert30/miniconda3/envs/gtsfm-v7/lib/python3.9/site-packages/distributed/worker.py", line 3269, in get_data_from_worker
    return await retry_operation(_get_data, operation="get_data_from_worker")
  File "/nethome/jlambert30/miniconda3/envs/gtsfm-v7/lib/python3.9/site-packages/distributed/utils_comm.py", line 384, in retry_operation
    return await retry(
  File "/nethome/jlambert30/miniconda3/envs/gtsfm-v7/lib/python3.9/site-packages/distributed/utils_comm.py", line 369, in retry
    return await coro()
  File "/nethome/jlambert30/miniconda3/envs/gtsfm-v7/lib/python3.9/site-packages/distributed/worker.py", line 3249, in _get_data
    response = await send_recv(
  File "/nethome/jlambert30/miniconda3/envs/gtsfm-v7/lib/python3.9/site-packages/distributed/core.py", line 661, in send_recv
    response = await comm.read(deserializers=deserializers)
  File "/nethome/jlambert30/miniconda3/envs/gtsfm-v7/lib/python3.9/site-packages/distributed/comm/tcp.py", line 212, in read
    msg = await from_frames(
  File "/nethome/jlambert30/miniconda3/envs/gtsfm-v7/lib/python3.9/site-packages/distributed/comm/utils.py", line 80, in from_frames
    res = _from_frames()
  File "/nethome/jlambert30/miniconda3/envs/gtsfm-v7/lib/python3.9/site-packages/distributed/comm/utils.py", line 63, in _from_frames
    return protocol.loads(
  File "/nethome/jlambert30/miniconda3/envs/gtsfm-v7/lib/python3.9/site-packages/distributed/protocol/core.py", line 151, in loads
    value = _deserialize(head, fs, deserializers=deserializers)
  File "/nethome/jlambert30/miniconda3/envs/gtsfm-v7/lib/python3.9/site-packages/distributed/protocol/serialize.py", line 374, in deserialize
    return loads(header, frames)
  File "/nethome/jlambert30/miniconda3/envs/gtsfm-v7/lib/python3.9/site-packages/distributed/protocol/serialize.py", line 154, in serialization_error_loads
    raise TypeError(msg)
TypeError: Could not serialize object of type SfmData.
Traceback (most recent call last):
  File "/nethome/jlambert30/miniconda3/envs/gtsfm-v7/lib/python3.9/site-packages/distributed/protocol/serialize.py", line 297, in serialize
    header, frames = dumps(x, context=context) if wants_context else dumps(x)
  File "/nethome/jlambert30/miniconda3/envs/gtsfm-v7/lib/python3.9/site-packages/distributed/protocol/serialize.py", line 42, in dask_dumps
    header, frames = dumps(x)
  File "/nethome/jlambert30/gtsfm/gtsfm/utils/serialization.py", line 232, in serialize_SfmData
    frames = [bytes(obj.serialize(), "utf-8")]
AttributeError: 'gtsam.gtsam.SfmData' object has no attribute 'serialize'

distributed.core - ERROR - Exception while handling op get_data
Traceback (most recent call last):
  File "/nethome/jlambert30/miniconda3/envs/gtsfm-v7/lib/python3.9/site-packages/distributed/core.py", line 517, in handle_comm
    result = await result
  File "/nethome/jlambert30/miniconda3/envs/gtsfm-v7/lib/python3.9/site-packages/distributed/worker.py", line 1349, in get_data
    assert response == "OK", response
AssertionError: {'op': 'get_data', 'keys': ('filter_landmarks-609f8462-9a0a-4f9f-978d-f987705afef6',), 'who': 'tcp://127.0.0.1:33771', 'max_connections': None, 'reply': True}
distributed.worker - ERROR - {'op': 'get_data', 'keys': ('filter_landmarks-609f8462-9a0a-4f9f-978d-f987705afef6',), 'who': 'tcp://127.0.0.1:33771', 'max_connections': None, 'reply': True}
Traceback (most recent call last):
  File "/nethome/jlambert30/miniconda3/envs/gtsfm-v7/lib/python3.9/site-packages/distributed/worker.py", line 2032, in gather_dep
    response = await get_data_from_worker(
  File "/nethome/jlambert30/miniconda3/envs/gtsfm-v7/lib/python3.9/site-packages/distributed/worker.py", line 3269, in get_data_from_worker
    return await retry_operation(_get_data, operation="get_data_from_worker")
  File "/nethome/jlambert30/miniconda3/envs/gtsfm-v7/lib/python3.9/site-packages/distributed/utils_comm.py", line 384, in retry_operation
    return await retry(
  File "/nethome/jlambert30/miniconda3/envs/gtsfm-v7/lib/python3.9/site-packages/distributed/utils_comm.py", line 369, in retry
    return await coro()
  File "/nethome/jlambert30/miniconda3/envs/gtsfm-v7/lib/python3.9/site-packages/distributed/worker.py", line 3249, in _get_data
    response = await send_recv(
  File "/nethome/jlambert30/miniconda3/envs/gtsfm-v7/lib/python3.9/site-packages/distributed/core.py", line 677, in send_recv
    raise exc.with_traceback(tb)
  File "/nethome/jlambert30/miniconda3/envs/gtsfm-v7/lib/python3.9/site-packages/distributed/core.py", line 517, in handle_comm
    result = await result
  File "/nethome/jlambert30/miniconda3/envs/gtsfm-v7/lib/python3.9/site-packages/distributed/worker.py", line 1349, in get_data
    assert response == "OK", response
AssertionError: {'op': 'get_data', 'keys': ('filter_landmarks-609f8462-9a0a-4f9f-978d-f987705afef6',), 'who': 'tcp://127.0.0.1:33771', 'max_connections': None, 'reply': True}
distributed.utils - ERROR - {'op': 'get_data', 'keys': ('filter_landmarks-609f8462-9a0a-4f9f-978d-f987705afef6',), 'who': 'tcp://127.0.0.1:33771', 'max_connections': None, 'reply': True}
Traceback (most recent call last):
  File "/nethome/jlambert30/miniconda3/envs/gtsfm-v7/lib/python3.9/site-packages/distributed/utils.py", line 655, in log_errors
    yield
  File "/nethome/jlambert30/miniconda3/envs/gtsfm-v7/lib/python3.9/site-packages/distributed/worker.py", line 2032, in gather_dep
    response = await get_data_from_worker(
  File "/nethome/jlambert30/miniconda3/envs/gtsfm-v7/lib/python3.9/site-packages/distributed/worker.py", line 3269, in get_data_from_worker
    return await retry_operation(_get_data, operation="get_data_from_worker")
  File "/nethome/jlambert30/miniconda3/envs/gtsfm-v7/lib/python3.9/site-packages/distributed/utils_comm.py", line 384, in retry_operation
    return await retry(
  File "/nethome/jlambert30/miniconda3/envs/gtsfm-v7/lib/python3.9/site-packages/distributed/utils_comm.py", line 369, in retry
    return await coro()
  File "/nethome/jlambert30/miniconda3/envs/gtsfm-v7/lib/python3.9/site-packages/distributed/worker.py", line 3249, in _get_data
    response = await send_recv(
  File "/nethome/jlambert30/miniconda3/envs/gtsfm-v7/lib/python3.9/site-packages/distributed/core.py", line 677, in send_recv
    raise exc.with_traceback(tb)
  File "/nethome/jlambert30/miniconda3/envs/gtsfm-v7/lib/python3.9/site-packages/distributed/core.py", line 517, in handle_comm
    result = await result
  File "/nethome/jlambert30/miniconda3/envs/gtsfm-v7/lib/python3.9/site-packages/distributed/worker.py", line 1349, in get_data
    assert response == "OK", response
AssertionError: {'op': 'get_data', 'keys': ('filter_landmarks-609f8462-9a0a-4f9f-978d-f987705afef6',), 'who': 'tcp://127.0.0.1:33771', 'max_connections': None, 'reply': True}
tornado.application - ERROR - Exception in callback functools.partial(<bound method IOLoop._discard_future_result of <tornado.platform.asyncio.AsyncIOLoop object at 0x7f00c80fb7c0>>, <Task finished name='Task-7799' coro=<Worker.gather_dep() done, defined at /nethome/jlambert30/miniconda3/envs/gtsfm-v7/lib/python3.9/site-packages/distributed/worker.py:2000> exception=AssertionError({'op': 'get_data', 'keys': ('filter_landmarks-609f8462-9a0a-4f9f-978d-f987705afef6',), 'who': 'tcp://127.0.0.1:33771', 'max_connections': None, 'reply': True})>)
Traceback (most recent call last):
  File "/nethome/jlambert30/miniconda3/envs/gtsfm-v7/lib/python3.9/site-packages/tornado/ioloop.py", line 741, in _run_callback
    ret = callback()
  File "/nethome/jlambert30/miniconda3/envs/gtsfm-v7/lib/python3.9/site-packages/tornado/ioloop.py", line 765, in _discard_future_result
    future.result()
  File "/nethome/jlambert30/miniconda3/envs/gtsfm-v7/lib/python3.9/site-packages/distributed/worker.py", line 2032, in gather_dep
    response = await get_data_from_worker(
  File "/nethome/jlambert30/miniconda3/envs/gtsfm-v7/lib/python3.9/site-packages/distributed/worker.py", line 3269, in get_data_from_worker
    return await retry_operation(_get_data, operation="get_data_from_worker")
  File "/nethome/jlambert30/miniconda3/envs/gtsfm-v7/lib/python3.9/site-packages/distributed/utils_comm.py", line 384, in retry_operation
    return await retry(
  File "/nethome/jlambert30/miniconda3/envs/gtsfm-v7/lib/python3.9/site-packages/distributed/utils_comm.py", line 369, in retry
    return await coro()
  File "/nethome/jlambert30/miniconda3/envs/gtsfm-v7/lib/python3.9/site-packages/distributed/worker.py", line 3249, in _get_data
    response = await send_recv(
  File "/nethome/jlambert30/miniconda3/envs/gtsfm-v7/lib/python3.9/site-packages/distributed/core.py", line 677, in send_recv
    raise exc.with_traceback(tb)
  File "/nethome/jlambert30/miniconda3/envs/gtsfm-v7/lib/python3.9/site-packages/distributed/core.py", line 517, in handle_comm
    result = await result
  File "/nethome/jlambert30/miniconda3/envs/gtsfm-v7/lib/python3.9/site-packages/distributed/worker.py", line 1349, in get_data
    assert response == "OK", response
AssertionError: {'op': 'get_data', 'keys': ('filter_landmarks-609f8462-9a0a-4f9f-978d-f987705afef6',), 'who': 'tcp://127.0.0.1:33771', 'max_connections': None, 'reply': True}
distributed.protocol.core - CRITICAL - Failed to deserialize
Traceback (most recent call last):
  File "/nethome/jlambert30/miniconda3/envs/gtsfm-v7/lib/python3.9/site-packages/distributed/protocol/core.py", line 151, in loads
    value = _deserialize(head, fs, deserializers=deserializers)
  File "/nethome/jlambert30/miniconda3/envs/gtsfm-v7/lib/python3.9/site-packages/distributed/protocol/serialize.py", line 374, in deserialize
    return loads(header, frames)
  File "/nethome/jlambert30/miniconda3/envs/gtsfm-v7/lib/python3.9/site-packages/distributed/protocol/serialize.py", line 154, in serialization_error_loads
    raise TypeError(msg)
TypeError: Could not serialize object of type SfmData.
Traceback (most recent call last):
  File "/nethome/jlambert30/miniconda3/envs/gtsfm-v7/lib/python3.9/site-packages/distributed/protocol/serialize.py", line 297, in serialize
    header, frames = dumps(x, context=context) if wants_context else dumps(x)
  File "/nethome/jlambert30/miniconda3/envs/gtsfm-v7/lib/python3.9/site-packages/distributed/protocol/serialize.py", line 42, in dask_dumps
    header, frames = dumps(x)
  File "/nethome/jlambert30/gtsfm/gtsfm/utils/serialization.py", line 232, in serialize_SfmData
    frames = [bytes(obj.serialize(), "utf-8")]
AttributeError: 'gtsam.gtsam.SfmData' object has no attribute 'serialize'

distributed.worker - ERROR - Could not serialize object of type SfmData.
Traceback (most recent call last):
  File "/nethome/jlambert30/miniconda3/envs/gtsfm-v7/lib/python3.9/site-packages/distributed/protocol/serialize.py", line 297, in serialize
    header, frames = dumps(x, context=context) if wants_context else dumps(x)
  File "/nethome/jlambert30/miniconda3/envs/gtsfm-v7/lib/python3.9/site-packages/distributed/protocol/serialize.py", line 42, in dask_dumps
    header, frames = dumps(x)
  File "/nethome/jlambert30/gtsfm/gtsfm/utils/serialization.py", line 232, in serialize_SfmData
    frames = [bytes(obj.serialize(), "utf-8")]
AttributeError: 'gtsam.gtsam.SfmData' object has no attribute 'serialize'
Traceback (most recent call last):
  File "/nethome/jlambert30/miniconda3/envs/gtsfm-v7/lib/python3.9/site-packages/distributed/worker.py", line 2032, in gather_dep
    response = await get_data_from_worker(
  File "/nethome/jlambert30/miniconda3/envs/gtsfm-v7/lib/python3.9/site-packages/distributed/worker.py", line 3269, in get_data_from_worker
    return await retry_operation(_get_data, operation="get_data_from_worker")
  File "/nethome/jlambert30/miniconda3/envs/gtsfm-v7/lib/python3.9/site-packages/distributed/utils_comm.py", line 384, in retry_operation
    return await retry(
  File "/nethome/jlambert30/miniconda3/envs/gtsfm-v7/lib/python3.9/site-packages/distributed/utils_comm.py", line 369, in retry
    return await coro()
  File "/nethome/jlambert30/miniconda3/envs/gtsfm-v7/lib/python3.9/site-packages/distributed/worker.py", line 3249, in _get_data
    response = await send_recv(
  File "/nethome/jlambert30/miniconda3/envs/gtsfm-v7/lib/python3.9/site-packages/distributed/core.py", line 661, in send_recv
    response = await comm.read(deserializers=deserializers)
  File "/nethome/jlambert30/miniconda3/envs/gtsfm-v7/lib/python3.9/site-packages/distributed/comm/tcp.py", line 212, in read
    msg = await from_frames(
  File "/nethome/jlambert30/miniconda3/envs/gtsfm-v7/lib/python3.9/site-packages/distributed/comm/utils.py", line 80, in from_frames
    res = _from_frames()
  File "/nethome/jlambert30/miniconda3/envs/gtsfm-v7/lib/python3.9/site-packages/distributed/comm/utils.py", line 63, in _from_frames
    return protocol.loads(
  File "/nethome/jlambert30/miniconda3/envs/gtsfm-v7/lib/python3.9/site-packages/distributed/protocol/core.py", line 151, in loads
    value = _deserialize(head, fs, deserializers=deserializers)
  File "/nethome/jlambert30/miniconda3/envs/gtsfm-v7/lib/python3.9/site-packages/distributed/protocol/serialize.py", line 374, in deserialize
    return loads(header, frames)
  File "/nethome/jlambert30/miniconda3/envs/gtsfm-v7/lib/python3.9/site-packages/distributed/protocol/serialize.py", line 154, in serialization_error_loads
    raise TypeError(msg)
TypeError: Could not serialize object of type SfmData.
Traceback (most recent call last):
  File "/nethome/jlambert30/miniconda3/envs/gtsfm-v7/lib/python3.9/site-packages/distributed/protocol/serialize.py", line 297, in serialize
    header, frames = dumps(x, context=context) if wants_context else dumps(x)
  File "/nethome/jlambert30/miniconda3/envs/gtsfm-v7/lib/python3.9/site-packages/distributed/protocol/serialize.py", line 42, in dask_dumps
    header, frames = dumps(x)
  File "/nethome/jlambert30/gtsfm/gtsfm/utils/serialization.py", line 232, in serialize_SfmData
    frames = [bytes(obj.serialize(), "utf-8")]
AttributeError: 'gtsam.gtsam.SfmData' object has no attribute 'serialize'

distributed.utils - ERROR - Could not serialize object of type SfmData.
Traceback (most recent call last):
  File "/nethome/jlambert30/miniconda3/envs/gtsfm-v7/lib/python3.9/site-packages/distributed/protocol/serialize.py", line 297, in serialize
    header, frames = dumps(x, context=context) if wants_context else dumps(x)
  File "/nethome/jlambert30/miniconda3/envs/gtsfm-v7/lib/python3.9/site-packages/distributed/protocol/serialize.py", line 42, in dask_dumps
    header, frames = dumps(x)
  File "/nethome/jlambert30/gtsfm/gtsfm/utils/serialization.py", line 232, in serialize_SfmData
    frames = [bytes(obj.serialize(), "utf-8")]
AttributeError: 'gtsam.gtsam.SfmData' object has no attribute 'serialize'
Traceback (most recent call last):
  File "/nethome/jlambert30/miniconda3/envs/gtsfm-v7/lib/python3.9/site-packages/distributed/utils.py", line 655, in log_errors
    yield
  File "/nethome/jlambert30/miniconda3/envs/gtsfm-v7/lib/python3.9/site-packages/distributed/worker.py", line 2032, in gather_dep
    response = await get_data_from_worker(
  File "/nethome/jlambert30/miniconda3/envs/gtsfm-v7/lib/python3.9/site-packages/distributed/worker.py", line 3269, in get_data_from_worker
    return await retry_operation(_get_data, operation="get_data_from_worker")
  File "/nethome/jlambert30/miniconda3/envs/gtsfm-v7/lib/python3.9/site-packages/distributed/utils_comm.py", line 384, in retry_operation
    return await retry(
  File "/nethome/jlambert30/miniconda3/envs/gtsfm-v7/lib/python3.9/site-packages/distributed/utils_comm.py", line 369, in retry
    return await coro()
  File "/nethome/jlambert30/miniconda3/envs/gtsfm-v7/lib/python3.9/site-packages/distributed/worker.py", line 3249, in _get_data
    response = await send_recv(
  File "/nethome/jlambert30/miniconda3/envs/gtsfm-v7/lib/python3.9/site-packages/distributed/core.py", line 661, in send_recv
    response = await comm.read(deserializers=deserializers)
  File "/nethome/jlambert30/miniconda3/envs/gtsfm-v7/lib/python3.9/site-packages/distributed/comm/tcp.py", line 212, in read
    msg = await from_frames(
  File "/nethome/jlambert30/miniconda3/envs/gtsfm-v7/lib/python3.9/site-packages/distributed/comm/utils.py", line 80, in from_frames
    res = _from_frames()
  File "/nethome/jlambert30/miniconda3/envs/gtsfm-v7/lib/python3.9/site-packages/distributed/comm/utils.py", line 63, in _from_frames
    return protocol.loads(
  File "/nethome/jlambert30/miniconda3/envs/gtsfm-v7/lib/python3.9/site-packages/distributed/protocol/core.py", line 151, in loads
    value = _deserialize(head, fs, deserializers=deserializers)
  File "/nethome/jlambert30/miniconda3/envs/gtsfm-v7/lib/python3.9/site-packages/distributed/protocol/serialize.py", line 374, in deserialize
    return loads(header, frames)
  File "/nethome/jlambert30/miniconda3/envs/gtsfm-v7/lib/python3.9/site-packages/distributed/protocol/serialize.py", line 154, in serialization_error_loads
    raise TypeError(msg)
TypeError: Could not serialize object of type SfmData.
Traceback (most recent call last):
  File "/nethome/jlambert30/miniconda3/envs/gtsfm-v7/lib/python3.9/site-packages/distributed/protocol/serialize.py", line 297, in serialize
    header, frames = dumps(x, context=context) if wants_context else dumps(x)
  File "/nethome/jlambert30/miniconda3/envs/gtsfm-v7/lib/python3.9/site-packages/distributed/protocol/serialize.py", line 42, in dask_dumps
    header, frames = dumps(x)
  File "/nethome/jlambert30/gtsfm/gtsfm/utils/serialization.py", line 232, in serialize_SfmData
    frames = [bytes(obj.serialize(), "utf-8")]
AttributeError: 'gtsam.gtsam.SfmData' object has no attribute 'serialize'

tornado.application - ERROR - Exception in callback functools.partial(<bound method IOLoop._discard_future_result of <tornado.platform.asyncio.AsyncIOLoop object at 0x7f00c80fb7c0>>, <Task finished name='Task-7806' coro=<Worker.gather_dep() done, defined at /nethome/jlambert30/miniconda3/envs/gtsfm-v7/lib/python3.9/site-packages/distributed/worker.py:2000> exception=TypeError('Could not serialize object of type SfmData.\nTraceback (most recent call last):\n  File "/nethome/jlambert30/miniconda3/envs/gtsfm-v7/lib/python3.9/site-packages/distributed/protocol/serialize.py", line 297, in serialize\n    header, frames = dumps(x, context=context) if wants_context else dumps(x)\n  File "/nethome/jlambert30/miniconda3/envs/gtsfm-v7/lib/python3.9/site-packages/distributed/protocol/serialize.py", line 42, in dask_dumps\n    header, frames = dumps(x)\n  File "/nethome/jlambert30/gtsfm/gtsfm/utils/serialization.py", line 232, in serialize_SfmData\n    frames = [bytes(obj.serialize(), "utf-8")]\nAttributeError: \'gtsam.gtsam.SfmData\' object has no attribute \'serialize\'\n')>)
Traceback (most recent call last):
  File "/nethome/jlambert30/miniconda3/envs/gtsfm-v7/lib/python3.9/site-packages/tornado/ioloop.py", line 741, in _run_callback
    ret = callback()
  File "/nethome/jlambert30/miniconda3/envs/gtsfm-v7/lib/python3.9/site-packages/tornado/ioloop.py", line 765, in _discard_future_result
    future.result()
  File "/nethome/jlambert30/miniconda3/envs/gtsfm-v7/lib/python3.9/site-packages/distributed/worker.py", line 2032, in gather_dep
    response = await get_data_from_worker(
  File "/nethome/jlambert30/miniconda3/envs/gtsfm-v7/lib/python3.9/site-packages/distributed/worker.py", line 3269, in get_data_from_worker
    return await retry_operation(_get_data, operation="get_data_from_worker")
  File "/nethome/jlambert30/miniconda3/envs/gtsfm-v7/lib/python3.9/site-packages/distributed/utils_comm.py", line 384, in retry_operation
    return await retry(
  File "/nethome/jlambert30/miniconda3/envs/gtsfm-v7/lib/python3.9/site-packages/distributed/utils_comm.py", line 369, in retry
    return await coro()
  File "/nethome/jlambert30/miniconda3/envs/gtsfm-v7/lib/python3.9/site-packages/distributed/worker.py", line 3249, in _get_data
    response = await send_recv(
  File "/nethome/jlambert30/miniconda3/envs/gtsfm-v7/lib/python3.9/site-packages/distributed/core.py", line 661, in send_recv
    response = await comm.read(deserializers=deserializers)
  File "/nethome/jlambert30/miniconda3/envs/gtsfm-v7/lib/python3.9/site-packages/distributed/comm/tcp.py", line 212, in read
    msg = await from_frames(
  File "/nethome/jlambert30/miniconda3/envs/gtsfm-v7/lib/python3.9/site-packages/distributed/comm/utils.py", line 80, in from_frames
    res = _from_frames()
  File "/nethome/jlambert30/miniconda3/envs/gtsfm-v7/lib/python3.9/site-packages/distributed/comm/utils.py", line 63, in _from_frames
    return protocol.loads(
  File "/nethome/jlambert30/miniconda3/envs/gtsfm-v7/lib/python3.9/site-packages/distributed/protocol/core.py", line 151, in loads
    value = _deserialize(head, fs, deserializers=deserializers)
  File "/nethome/jlambert30/miniconda3/envs/gtsfm-v7/lib/python3.9/site-packages/distributed/protocol/serialize.py", line 374, in deserialize
    return loads(header, frames)
  File "/nethome/jlambert30/miniconda3/envs/gtsfm-v7/lib/python3.9/site-packages/distributed/protocol/serialize.py", line 154, in serialization_error_loads
    raise TypeError(msg)
TypeError: Could not serialize object of type SfmData.
Traceback (most recent call last):
  File "/nethome/jlambert30/miniconda3/envs/gtsfm-v7/lib/python3.9/site-packages/distributed/protocol/serialize.py", line 297, in serialize
    header, frames = dumps(x, context=context) if wants_context else dumps(x)
  File "/nethome/jlambert30/miniconda3/envs/gtsfm-v7/lib/python3.9/site-packages/distributed/protocol/serialize.py", line 42, in dask_dumps
    header, frames = dumps(x)
  File "/nethome/jlambert30/gtsfm/gtsfm/utils/serialization.py", line 232, in serialize_SfmData
    frames = [bytes(obj.serialize(), "utf-8")]
AttributeError: 'gtsam.gtsam.SfmData' object has no attribute 'serialize'

distributed.core - ERROR - Exception while handling op get_data
Traceback (most recent call last):
  File "/nethome/jlambert30/miniconda3/envs/gtsfm-v7/lib/python3.9/site-packages/distributed/core.py", line 517, in handle_comm
    result = await result
  File "/nethome/jlambert30/miniconda3/envs/gtsfm-v7/lib/python3.9/site-packages/distributed/worker.py", line 1349, in get_data
    assert response == "OK", response
AssertionError: {'op': 'get_data', 'keys': ('filter_landmarks-609f8462-9a0a-4f9f-978d-f987705afef6',), 'who': 'tcp://127.0.0.1:33771', 'max_connections': None, 'reply': True}
distributed.worker - ERROR - {'op': 'get_data', 'keys': ('filter_landmarks-609f8462-9a0a-4f9f-978d-f987705afef6',), 'who': 'tcp://127.0.0.1:33771', 'max_connections': None, 'reply': True}
Traceback (most recent call last):
  File "/nethome/jlambert30/miniconda3/envs/gtsfm-v7/lib/python3.9/site-packages/distributed/worker.py", line 2032, in gather_dep
    response = await get_data_from_worker(
  File "/nethome/jlambert30/miniconda3/envs/gtsfm-v7/lib/python3.9/site-packages/distributed/worker.py", line 3269, in get_data_from_worker
    return await retry_operation(_get_data, operation="get_data_from_worker")
  File "/nethome/jlambert30/miniconda3/envs/gtsfm-v7/lib/python3.9/site-packages/distributed/utils_comm.py", line 384, in retry_operation
    return await retry(
  File "/nethome/jlambert30/miniconda3/envs/gtsfm-v7/lib/python3.9/site-packages/distributed/utils_comm.py", line 369, in retry
    return await coro()
  File "/nethome/jlambert30/miniconda3/envs/gtsfm-v7/lib/python3.9/site-packages/distributed/worker.py", line 3249, in _get_data
    response = await send_recv(
  File "/nethome/jlambert30/miniconda3/envs/gtsfm-v7/lib/python3.9/site-packages/distributed/core.py", line 677, in send_recv
    raise exc.with_traceback(tb)
  File "/nethome/jlambert30/miniconda3/envs/gtsfm-v7/lib/python3.9/site-packages/distributed/core.py", line 517, in handle_comm
    result = await result
  File "/nethome/jlambert30/miniconda3/envs/gtsfm-v7/lib/python3.9/site-packages/distributed/worker.py", line 1349, in get_data
    assert response == "OK", response
AssertionError: {'op': 'get_data', 'keys': ('filter_landmarks-609f8462-9a0a-4f9f-978d-f987705afef6',), 'who': 'tcp://127.0.0.1:33771', 'max_connections': None, 'reply': True}
distributed.utils - ERROR - {'op': 'get_data', 'keys': ('filter_landmarks-609f8462-9a0a-4f9f-978d-f987705afef6',), 'who': 'tcp://127.0.0.1:33771', 'max_connections': None, 'reply': True}
Traceback (most recent call last):

@akshay-krishnan akshay-krishnan added the bug Something isn't working label Sep 1, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
bug Something isn't working
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@johnwlambert @akshay-krishnan