add additional error handling for Rabbitmq, improved answer parsing, remove unused dependencies, linting

[renehonig]

Describe the background of your pull request

Add error handling for publishing responses to Rabbitmq.
Note that this does not create full robustness against Rabbitmq service failure, but should hopefully resolve an observed issue with Rabbitmq during testing.

Governance

• Documentation is added
• Test cases are added or updated

By submitting this pull request I confirm that:

• I've read the contributing document https://github.com/alkem-io/.github/blob/master/CONTRIBUTING.md.
• I've read and understand the Code of Conduct https://github.com/alkem-io/.github/blob/master/CODE_OF_CONDUCT.md.
• I understand that any contributions or suggestions I made may make it into the actual code. I've read the License
  https://github.com/alkem-io/Coordination/blob/master/LICENSE.
• I understand that submitting the pull request requires agreeing to and signing the contributor license agreement.

[valentinyanakiev]

I've tried on acc, still got:

01-05 12:12:56 - def_ingest - INFO - generating html: /app/data/website/source, https://www.alkemio.org
01-05 12:12:56 - def_ingest - INFO - Extracting urls using /app/data/website/generated/sitemap.xml
01-05 12:12:58 - def_ingest - INFO - ==> Returning 78 files; 0 gave errors + 126 files were skipped
01-05 12:12:59 - def_ingest - INFO - generating html: /app/data/website2/source, https://welcome.alkem.io
01-05 12:12:59 - def_ingest - INFO - Extracting urls using /app/data/website2/generated/sitemap.xml
01-05 12:13:01 - def_ingest - INFO - ==> Returning 59 files; 0 gave errors + 75 files were skipped
01-05 12:13:21 - def_ingest - INFO -
Embedding costs: 0.0
01-05 12:13:21 - main - INFO - Ingest operation completed
01-05 12:13:21 - main - ERROR - Failed to publish message due to a RabbitMQ error:
Exception in callback _task_done(<Task finishe...dStateError()>) at /root/.cache/pypoetry/virtualenvs/guidance-engine-9TtSrW0h-py3.11/lib/python3.11/site-packages/aio_pika/tools.py:43
handle: <Handle _task_done(<Task finishe...dStateError()>) at /root/.cache/pypoetry/virtualenvs/guidance-engine-9TtSrW0h-py3.11/lib/python3.11/site-packages/aio_pika/tools.py:43>
Traceback (most recent call last):
File "/usr/local/lib/python3.11/asyncio/events.py", line 80, in _run
self._context.run(self._callback, *self._args)
File "/root/.cache/pypoetry/virtualenvs/guidance-engine-9TtSrW0h-py3.11/lib/python3.11/site-packages/aio_pika/tools.py", line 47, in _task_done
raise exc
File "/app/guidance_engine.py", line 137, in on_request
async with message.process():
File "/root/.cache/pypoetry/virtualenvs/guidance-engine-9TtSrW0h-py3.11/lib/python3.11/site-packages/aio_pika/message.py", line 586, in aexit
await self.message.ack()
File "/root/.cache/pypoetry/virtualenvs/guidance-engine-9TtSrW0h-py3.11/lib/python3.11/site-packages/aio_pika/message.py", line 476, in ack
await self.channel.basic_ack(
^^^^^^^^^^^^
File "/root/.cache/pypoetry/virtualenvs/guidance-engine-9TtSrW0h-py3.11/lib/python3.11/site-packages/aio_pika/message.py", line 414, in channel
raise ChannelInvalidStateError
aiormq.exceptions.ChannelInvalidStateError