Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[BUG] - Bulk Import Failing RC2 #2788

Closed
6 tasks done
zierbeek opened this issue Dec 5, 2023 · 10 comments · Fixed by #2796
Closed
6 tasks done

[BUG] - Bulk Import Failing RC2 #2788

zierbeek opened this issue Dec 5, 2023 · 10 comments · Fixed by #2796
Labels
bug: confirmed bug Something isn't working

Comments

@zierbeek
Copy link
Contributor

zierbeek commented Dec 5, 2023

First Check

  • This is not a feature request.
  • I added a very descriptive title to this issue.
  • I used the GitHub search to find a similar issue and didn't find it.
  • I searched the Mealie documentation, with the integrated search.
  • I already read the docs and didn't find an answer.
  • This issue can be replicated on the demo site (https://demo.mealie.io/).

What is the issue you are experiencing?

Bulk import fails to import and doesn't throw an error.

Steps to Reproduce

1)Import url
2) Add bulk import
3) Add urls
4) Send

Please provide relevant logs

        File "/opt/pysetup/.venv/lib/python3.10/site-packages/anyio/_backends/_asyncio.py", line 1230, in send

    


          await checkpoint()

    


        File "/opt/pysetup/.venv/lib/python3.10/site-packages/anyio/_backends/_asyncio.py", line 447, in checkpoint

    


          await sleep(0)

    


        File "/usr/local/lib/python3.10/asyncio/tasks.py", line 596, in sleep

    


          await __sleep0()

    


        File "/usr/local/lib/python3.10/asyncio/tasks.py", line 590, in __sleep0

    


          yield

    


      asyncio.exceptions.CancelledError

    


      

    


      During handling of the above exception, another exception occurred:

    


      

    


      Traceback (most recent call last):

    


        File "/opt/pysetup/.venv/lib/python3.10/site-packages/httpcore/_exceptions.py", line 10, in map_exceptions

    


          yield

    


        File "/opt/pysetup/.venv/lib/python3.10/site-packages/httpcore/backends/asyncio.py", line 78, in start_tls

    


          raise exc

    


        File "/opt/pysetup/.venv/lib/python3.10/site-packages/httpcore/backends/asyncio.py", line 68, in start_tls

    


          with anyio.fail_after(timeout):

    


        File "/opt/pysetup/.venv/lib/python3.10/site-packages/anyio/_core/_tasks.py", line 119, in __exit__

    


          raise TimeoutError

    


      TimeoutError

    


      

    


      During handling of the above exception, another exception occurred:

    


      

    


      Traceback (most recent call last):

    


        File "/opt/pysetup/.venv/lib/python3.10/site-packages/httpx/_transports/default.py", line 60, in map_httpcore_exceptions

    


          yield

    


        File "/opt/pysetup/.venv/lib/python3.10/site-packages/httpx/_transports/default.py", line 353, in handle_async_request

    


          resp = await self._pool.handle_async_request(req)

    


        File "/opt/pysetup/.venv/lib/python3.10/site-packages/httpcore/_async/connection_pool.py", line 253, in handle_async_request

    


          raise exc

    


        File "/opt/pysetup/.venv/lib/python3.10/site-packages/httpcore/_async/connection_pool.py", line 237, in handle_async_request

    


          response = await connection.handle_async_request(request)

    


        File "/opt/pysetup/.venv/lib/python3.10/site-packages/httpcore/_async/connection.py", line 86, in handle_async_request

    


          raise exc

    


        File "/opt/pysetup/.venv/lib/python3.10/site-packages/httpcore/_async/connection.py", line 63, in handle_async_request

    


          stream = await self._connect(request)

    


        File "/opt/pysetup/.venv/lib/python3.10/site-packages/httpcore/_async/connection.py", line 150, in _connect

    


          stream = await stream.start_tls(**kwargs)

    


        File "/opt/pysetup/.venv/lib/python3.10/site-packages/httpcore/backends/asyncio.py", line 66, in start_tls

    


          with map_exceptions(exc_map):

    


        File "/usr/local/lib/python3.10/contextlib.py", line 153, in __exit__

    


          self.gen.throw(typ, value, traceback)

    


        File "/opt/pysetup/.venv/lib/python3.10/site-packages/httpcore/_exceptions.py", line 14, in map_exceptions

    


          raise to_exc(exc)

    


      httpcore.ConnectTimeout

    


      

    


      The above exception was the direct cause of the following exception:

    


      

    


      Traceback (most recent call last):

    


        File "/app/mealie/services/scraper/scraper.py", line 45, in create_from_url

    


          await recipe_data_service.scrape_image(new_recipe.image)

    


        File "/app/mealie/services/recipe/recipe_data_service.py", line 129, in scrape_image

    


          image_url, _ = await largest_content_len(image_url)

    


        File "/app/mealie/services/recipe/recipe_data_service.py", line 34, in largest_content_len

    


          responses: list[Response] = await gather_with_concurrency(10, *tasks)

    


        File "/app/mealie/services/recipe/recipe_data_service.py", line 22, in gather_with_concurrency

    


          return await asyncio.gather(*(sem_coro(c) for c in coros))

    


        File "/app/mealie/services/recipe/recipe_data_service.py", line 20, in sem_coro

Mealie Version

Details
Versie: v1.0.0-RC2
Bouw: c9852da
Toepassingsmodus: Productie
Demostatus: Geen demo
API-poort: 10018
API-documentatie: Ingeschakeld
Databasetype: postgres
Versie van de receptenscraper: 14.52.0

Checks
Beveiligde website: Nee
Server-side basis-URL: Ja
LDAP klaar: Nee
E-mail geconfigureerd: Nee
Docker Volume: success

Deployment

Docker (Linux)

Additional Deployment Details

Truecharts Truenas scale

@zierbeek zierbeek added bug Something isn't working triage labels Dec 5, 2023
@michael-genson
Copy link
Collaborator

Do you happen to have a list of recipes that failed? I pulled 16 random ones off of allrecipes.com and it works for me.
I think I identified the issue based on your logs, but without a fail-case I can't test it

@zierbeek
Copy link
Contributor Author

zierbeek commented Dec 6, 2023

sure, could you share me your list?
i had this one

https://www.hap-en-tap.be/tricolore-opgerolde-pannenkoekjes-met-parmaham/
https://www.hellofresh.be/recipes/wildzwijnburger-met-ovenfrietjes-en-rodekool-appelsalade-5dc5419dc6696230d0459a40
https://www.hellofresh.be/recipes/zelfgemaakte-worstenbroodjes-5e78dcf665cf3542eb46577b
https://dagelijksekost.een.be/gerechten/chicken-wings-met-een-pittige-barbecuesaus
https://www.laurasbakery.nl/gevulde-champignons-met-geitenkaas-walnoot-en-honing/
https://www.ah.be/allerhande/recept/R-R972700/chocolade-abrikozentaart
https://www.hellofresh.be/recipes/broodje-hamburger-met-zomerse-meloensalade-606d726c4bb5d35d2a1cc724
https://www.hellofresh.be/recipes/tostada-met-gekruid-kipgehakt-en-cheddar-606d726705cb795572549fe2
https://www.hap-en-tap.be/canneles-met-gerookte-zalm/
https://metvijfaantafel.be/recept/alles-in-een-pan-gnocchi-met-spinazie-en-pesto/
https://www.laurasbakery.nl/deconstructed-lemon-meringue-pie-dessert/
https://www.hellofresh.be/recipes/luxe-caesarsalade-met-kip-en-spek-5e7a2aff69bd5368181ae482
https://www.dezondag.be/de-zondag/geniet/zondagse-kost/zondagse-kostcreme-kruimeltaart-of-knubbelkesvlaai/
https://www.libelle-lekker.be/bekijk-recept/290/zalmsteak-met-groenten
https://www.hap-en-tap.be/aardbeienmousse-balsamicomeringue-en-gedroogde-aardbeien
https://www.hellofresh.be/recipes/koreaanse-biefstukreepjes-met-rijst-5e8c44ec00dd6a07a051a89c
https://www.laurasbakery.nl/zelf-nougatine-maken/
https://itsnotaboutcooking.nl/brownies-noten-en-sinaasappel/
https://www.laurasbakery.nl/passievrucht-meringue-tartelettes/
https://www.laurasbakery.nl/italiaans-schuim/#recipe
https://dagelijksekost.een.be/gerechten/ossobuco
https://www.laurasbakery.nl/appel-havermoutkoekjes/
https://www.hap-en-tap.be/croquetas-de-jamon-serrano-y-queso-manchego/
https://www.laurasbakery.nl/banketbakkersroom/
https://www.hellofresh.be/recipes/milde-curry-met-spinazie-en-kikkererwten-606d7262fda24c420770cf79
https://www.laurasbakery.nl/lemon-curd/
https://mykoreankitchen.com/bibimbap-korean-mixed-rice-with-meat-and-assorted-vegetables/
https://njam.tv/recepten/amaretto-sour
https://metvijfaantafel.be/recept/alles-in-een-pan-tortellini-met-italiaanse-balletjes-en-burrata/
https://www.hellofresh.be/recipes/rijstbowl-met-varkenshaasreepjes-en-een-spiegelei-60b65014d0ff8c10c52a5268
https://www.hap-en-tap.be/pistache-brownie-van-maja/
https://www.laurasbakery.nl/mokkacreme/
https://www.hellofresh.nl/recipes/zweedse-stijl-gehaktballetjes-in-roomsaus-60d3403dd225e20150165c6f
https://www.hellofresh.be/recipes/rundvleesburger-met-gebakken-ui-spek-en-comte-607fe045dc8b4b7f3024478d
https://www.libelle-lekker.be/bekijk-recept/13207/groentepannetje-met-kip-en-geitenkaas
https://www.libelle-lekker.be/bekijk-recept/1587/lasagne-met-zalm-en-spinazie-1
https://joyfoodsunshine.com/apple-crumble-pie/
https://www.hellofresh.be/recipes/romige-aardappelsoep-met-garnalen-60e4673bda64bd4c0400407a
https://www.laurasbakery.nl/mokkataart/
https://www.hap-en-tap.be/kaashamkroketjes-mosterdcreme-gekleurde-tomaten/
https://www.hap-en-tap.be/koffie-chocolade-cupcakes-met-karamel-mascarpone-creme/
https://metvijfaantafel.be/recept/spaghetti-met-italiaanse-balletjes-in-tomatensaus/
https://www.hellofresh.be/recipes/zelfgemaakte-kipnuggets-5eb03107c86ec53e0c28a182
https://15gram.be/recepten/lichte-panna-cotta

@zierbeek
Copy link
Contributor Author

zierbeek commented Dec 6, 2023

confirm, this list is working!
more complete logs:

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/app/mealie/services/scraper/scraper.py", line 45, in create_from_url
    await recipe_data_service.scrape_image(new_recipe.image)
  File "/app/mealie/services/recipe/recipe_data_service.py", line 129, in scrape_image
    image_url, _ = await largest_content_len(image_url)
  File "/app/mealie/services/recipe/recipe_data_service.py", line 34, in largest_content_len
    responses: list[Response] = await gather_with_concurrency(10, *tasks)
  File "/app/mealie/services/recipe/recipe_data_service.py", line 22, in gather_with_concurrency
    return await asyncio.gather(*(sem_coro(c) for c in coros))
  File "/app/mealie/services/recipe/recipe_data_service.py", line 20, in sem_coro
    return await coro
  File "/app/mealie/services/recipe/recipe_data_service.py", line 30, in do
    return await client.head(url, headers={"User-Agent": _FIREFOX_UA})
  File "/opt/pysetup/.venv/lib/python3.10/site-packages/httpx/_client.py", line 1815, in head
    return await self.request(
  File "/opt/pysetup/.venv/lib/python3.10/site-packages/httpx/_client.py", line 1530, in request
    return await self.send(request, auth=auth, follow_redirects=follow_redirects)
  File "/opt/pysetup/.venv/lib/python3.10/site-packages/httpx/_client.py", line 1617, in send
    response = await self._send_handling_auth(
  File "/opt/pysetup/.venv/lib/python3.10/site-packages/httpx/_client.py", line 1645, in _send_handling_auth
    response = await self._send_handling_redirects(
  File "/opt/pysetup/.venv/lib/python3.10/site-packages/httpx/_client.py", line 1682, in _send_handling_redirects
    response = await self._send_single_request(request)
  File "/opt/pysetup/.venv/lib/python3.10/site-packages/httpx/_client.py", line 1719, in _send_single_request
    response = await transport.handle_async_request(request)
  File "/opt/pysetup/.venv/lib/python3.10/site-packages/httpx/_transports/default.py", line 352, in handle_async_request
    with map_httpcore_exceptions():
  File "/usr/local/lib/python3.10/contextlib.py", line 153, in __exit__
    self.gen.throw(typ, value, traceback)
  File "/opt/pysetup/.venv/lib/python3.10/site-packages/httpx/_transports/default.py", line 77, in map_httpcore_exceptions
    raise mapped_exc(message) from exc
httpx.ConnectTimeout
ERROR: 05-Dec-23 16:22:19 	Error Scraping Image: 
Traceback (most recent call last):
  File "/opt/pysetup/.venv/lib/python3.10/site-packages/httpcore/backends/asyncio.py", line 69, in start_tls
    ssl_stream = await anyio.streams.tls.TLSStream.wrap(
  File "/opt/pysetup/.venv/lib/python3.10/site-packages/anyio/streams/tls.py", line 123, in wrap
    await wrapper._call_sslobject_method(ssl_object.do_handshake)
  File "/opt/pysetup/.venv/lib/python3.10/site-packages/anyio/streams/tls.py", line 169, in _call_sslobject_method
    await self.transport_stream.send(self._write_bio.read())
  File "/opt/pysetup/.venv/lib/python3.10/site-packages/anyio/_backends/_asyncio.py", line 1230, in send
    await checkpoint()
  File "/opt/pysetup/.venv/lib/python3.10/site-packages/anyio/_backends/_asyncio.py", line 447, in checkpoint
    await sleep(0)
  File "/usr/local/lib/python3.10/asyncio/tasks.py", line 596, in sleep
    await __sleep0()
  File "/usr/local/lib/python3.10/asyncio/tasks.py", line 590, in __sleep0
    yield
asyncio.exceptions.CancelledError

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/opt/pysetup/.venv/lib/python3.10/site-packages/httpcore/_exceptions.py", line 10, in map_exceptions
    yield
  File "/opt/pysetup/.venv/lib/python3.10/site-packages/httpcore/backends/asyncio.py", line 78, in start_tls
    raise exc
  File "/opt/pysetup/.venv/lib/python3.10/site-packages/httpcore/backends/asyncio.py", line 68, in start_tls
    with anyio.fail_after(timeout):
  File "/opt/pysetup/.venv/lib/python3.10/site-packages/anyio/_core/_tasks.py", line 119, in __exit__
    raise TimeoutError
TimeoutError

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/opt/pysetup/.venv/lib/python3.10/site-packages/httpx/_transports/default.py", line 60, in map_httpcore_exceptions
    yield
  File "/opt/pysetup/.venv/lib/python3.10/site-packages/httpx/_transports/default.py", line 353, in handle_async_request
    resp = await self._pool.handle_async_request(req)
  File "/opt/pysetup/.venv/lib/python3.10/site-packages/httpcore/_async/connection_pool.py", line 253, in handle_async_request
    raise exc
  File "/opt/pysetup/.venv/lib/python3.10/site-packages/httpcore/_async/connection_pool.py", line 237, in handle_async_request
    response = await connection.handle_async_request(request)
  File "/opt/pysetup/.venv/lib/python3.10/site-packages/httpcore/_async/connection.py", line 86, in handle_async_request
    raise exc
  File "/opt/pysetup/.venv/lib/python3.10/site-packages/httpcore/_async/connection.py", line 63, in handle_async_request
    stream = await self._connect(request)
  File "/opt/pysetup/.venv/lib/python3.10/site-packages/httpcore/_async/connection.py", line 150, in _connect
    stream = await stream.start_tls(**kwargs)
  File "/opt/pysetup/.venv/lib/python3.10/site-packages/httpcore/backends/asyncio.py", line 66, in start_tls
    with map_exceptions(exc_map):
  File "/usr/local/lib/python3.10/contextlib.py", line 153, in __exit__
    self.gen.throw(typ, value, traceback)
  File "/opt/pysetup/.venv/lib/python3.10/site-packages/httpcore/_exceptions.py", line 14, in map_exceptions
    raise to_exc(exc)
httpcore.ConnectTimeout

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/app/mealie/services/scraper/scraper.py", line 45, in create_from_url
    await recipe_data_service.scrape_image(new_recipe.image)
  File "/app/mealie/services/recipe/recipe_data_service.py", line 129, in scrape_image
    image_url, _ = await largest_content_len(image_url)
  File "/app/mealie/services/recipe/recipe_data_service.py", line 34, in largest_content_len
    responses: list[Response] = await gather_with_concurrency(10, *tasks)
  File "/app/mealie/services/recipe/recipe_data_service.py", line 22, in gather_with_concurrency
    return await asyncio.gather(*(sem_coro(c) for c in coros))
  File "/app/mealie/services/recipe/recipe_data_service.py", line 20, in sem_coro
    return await coro
  File "/app/mealie/services/recipe/recipe_data_service.py", line 30, in do
    return await client.head(url, headers={"User-Agent": _FIREFOX_UA})
  File "/opt/pysetup/.venv/lib/python3.10/site-packages/httpx/_client.py", line 1815, in head
    return await self.request(
  File "/opt/pysetup/.venv/lib/python3.10/site-packages/httpx/_client.py", line 1530, in request
    return await self.send(request, auth=auth, follow_redirects=follow_redirects)
  File "/opt/pysetup/.venv/lib/python3.10/site-packages/httpx/_client.py", line 1617, in send
    response = await self._send_handling_auth(
  File "/opt/pysetup/.venv/lib/python3.10/site-packages/httpx/_client.py", line 1645, in _send_handling_auth
    response = await self._send_handling_redirects(
  File "/opt/pysetup/.venv/lib/python3.10/site-packages/httpx/_client.py", line 1682, in _send_handling_redirects
    response = await self._send_single_request(request)
  File "/opt/pysetup/.venv/lib/python3.10/site-packages/httpx/_client.py", line 1719, in _send_single_request
    response = await transport.handle_async_request(request)
  File "/opt/pysetup/.venv/lib/python3.10/site-packages/httpx/_transports/default.py", line 352, in handle_async_request
    with map_httpcore_exceptions():
  File "/usr/local/lib/python3.10/contextlib.py", line 153, in __exit__
    self.gen.throw(typ, value, traceback)
  File "/opt/pysetup/.venv/lib/python3.10/site-packages/httpx/_transports/default.py", line 77, in map_httpcore_exceptions
    raise mapped_exc(message) from exc
httpx.ConnectTimeout
ERROR: 05-Dec-23 16:22:19 	Fatal Image Request Exception
Traceback (most recent call last):
  File "/opt/pysetup/.venv/lib/python3.10/site-packages/httpcore/_exceptions.py", line 10, in map_exceptions
    yield
  File "/opt/pysetup/.venv/lib/python3.10/site-packages/httpcore/backends/asyncio.py", line 110, in connect_tcp
    with anyio.fail_after(timeout):
  File "/opt/pysetup/.venv/lib/python3.10/site-packages/anyio/_core/_tasks.py", line 119, in __exit__
    raise TimeoutError
TimeoutError

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/opt/pysetup/.venv/lib/python3.10/site-packages/httpx/_transports/default.py", line 60, in map_httpcore_exceptions
    yield
  File "/opt/pysetup/.venv/lib/python3.10/site-packages/httpx/_transports/default.py", line 353, in handle_async_request
    resp = await self._pool.handle_async_request(req)
  File "/opt/pysetup/.venv/lib/python3.10/site-packages/httpcore/_async/connection_pool.py", line 253, in handle_async_request
    raise exc
  File "/opt/pysetup/.venv/lib/python3.10/site-packages/httpcore/_async/connection_pool.py", line 237, in handle_async_request
    response = await connection.handle_async_request(request)
  File "/opt/pysetup/.venv/lib/python3.10/site-packages/httpcore/_async/connection.py", line 86, in handle_async_request
    raise exc
  File "/opt/pysetup/.venv/lib/python3.10/site-packages/httpcore/_async/connection.py", line 63, in handle_async_request
    stream = await self._connect(request)
  File "/opt/pysetup/.venv/lib/python3.10/site-packages/httpcore/_async/connection.py", line 111, in _connect
    stream = await self._network_backend.connect_tcp(**kwargs)
  File "/opt/pysetup/.venv/lib/python3.10/site-packages/httpcore/backends/auto.py", line 29, in connect_tcp
    return await self._backend.connect_tcp(
  File "/opt/pysetup/.venv/lib/python3.10/site-packages/httpcore/backends/asyncio.py", line 109, in connect_tcp
    with map_exceptions(exc_map):
  File "/usr/local/lib/python3.10/contextlib.py", line 153, in __exit__
    self.gen.throw(typ, value, traceback)
  File "/opt/pysetup/.venv/lib/python3.10/site-packages/httpcore/_exceptions.py", line 14, in map_exceptions
    raise to_exc(exc)
httpcore.ConnectTimeout

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/app/mealie/services/recipe/recipe_data_service.py", line 146, in scrape_image
    r = await client.get(image_url, headers={"User-Agent": _FIREFOX_UA})
  File "/opt/pysetup/.venv/lib/python3.10/site-packages/httpx/_client.py", line 1757, in get
    return await self.request(
  File "/opt/pysetup/.venv/lib/python3.10/site-packages/httpx/_client.py", line 1530, in request
    return await self.send(request, auth=auth, follow_redirects=follow_redirects)
  File "/opt/pysetup/.venv/lib/python3.10/site-packages/httpx/_client.py", line 1617, in send
    response = await self._send_handling_auth(
  File "/opt/pysetup/.venv/lib/python3.10/site-packages/httpx/_client.py", line 1645, in _send_handling_auth
    response = await self._send_handling_redirects(
  File "/opt/pysetup/.venv/lib/python3.10/site-packages/httpx/_client.py", line 1682, in _send_handling_redirects
    response = await self._send_single_request(request)
  File "/opt/pysetup/.venv/lib/python3.10/site-packages/httpx/_client.py", line 1719, in _send_single_request
    response = await transport.handle_async_request(request)
  File "/opt/pysetup/.venv/lib/python3.10/site-packages/httpx/_transports/default.py", line 352, in handle_async_request
    with map_httpcore_exceptions():
  File "/usr/local/lib/python3.10/contextlib.py", line 153, in __exit__
    self.gen.throw(typ, value, traceback)
  File "/opt/pysetup/.venv/lib/python3.10/site-packages/httpx/_transports/default.py", line 77, in map_httpcore_exceptions
    raise mapped_exc(message) from exc
httpx.ConnectTimeout
ERROR: 05-Dec-23 16:22:19 	Fatal Image Request Exception
Traceback (most recent call last):
  File "/opt/pysetup/.venv/lib/python3.10/site-packages/httpcore/_exceptions.py", line 10, in map_exceptions
    yield
  File "/opt/pysetup/.venv/lib/python3.10/site-packages/httpcore/backends/asyncio.py", line 110, in connect_tcp
    with anyio.fail_after(timeout):
  File "/opt/pysetup/.venv/lib/python3.10/site-packages/anyio/_core/_tasks.py", line 119, in __exit__
    raise TimeoutError
TimeoutError

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/opt/pysetup/.venv/lib/python3.10/site-packages/httpx/_transports/default.py", line 60, in map_httpcore_exceptions
    yield
  File "/opt/pysetup/.venv/lib/python3.10/site-packages/httpx/_transports/default.py", line 353, in handle_async_request
    resp = await self._pool.handle_async_request(req)
  File "/opt/pysetup/.venv/lib/python3.10/site-packages/httpcore/_async/connection_pool.py", line 253, in handle_async_request
    raise exc
  File "/opt/pysetup/.venv/lib/python3.10/site-packages/httpcore/_async/connection_pool.py", line 237, in handle_async_request
    response = await connection.handle_async_request(request)
  File "/opt/pysetup/.venv/lib/python3.10/site-packages/httpcore/_async/connection.py", line 86, in handle_async_request
    raise exc
  File "/opt/pysetup/.venv/lib/python3.10/site-packages/httpcore/_async/connection.py", line 63, in handle_async_request
    stream = await self._connect(request)
  File "/opt/pysetup/.venv/lib/python3.10/site-packages/httpcore/_async/connection.py", line 111, in _connect
    stream = await self._network_backend.connect_tcp(**kwargs)
  File "/opt/pysetup/.venv/lib/python3.10/site-packages/httpcore/backends/auto.py", line 29, in connect_tcp
    return await self._backend.connect_tcp(
  File "/opt/pysetup/.venv/lib/python3.10/site-packages/httpcore/backends/asyncio.py", line 109, in connect_tcp
    with map_exceptions(exc_map):
  File "/usr/local/lib/python3.10/contextlib.py", line 153, in __exit__
    self.gen.throw(typ, value, traceback)
  File "/opt/pysetup/.venv/lib/python3.10/site-packages/httpcore/_exceptions.py", line 14, in map_exceptions
    raise to_exc(exc)
httpcore.ConnectTimeout

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/app/mealie/services/recipe/recipe_data_service.py", line 146, in scrape_image
    r = await client.get(image_url, headers={"User-Agent": _FIREFOX_UA})
  File "/opt/pysetup/.venv/lib/python3.10/site-packages/httpx/_client.py", line 1757, in get
    return await self.request(
  File "/opt/pysetup/.venv/lib/python3.10/site-packages/httpx/_client.py", line 1530, in request
    return await self.send(request, auth=auth, follow_redirects=follow_redirects)
  File "/opt/pysetup/.venv/lib/python3.10/site-packages/httpx/_client.py", line 1617, in send
    response = await self._send_handling_auth(
  File "/opt/pysetup/.venv/lib/python3.10/site-packages/httpx/_client.py", line 1645, in _send_handling_auth
    response = await self._send_handling_redirects(
  File "/opt/pysetup/.venv/lib/python3.10/site-packages/httpx/_client.py", line 1682, in _send_handling_redirects
    response = await self._send_single_request(request)
  File "/opt/pysetup/.venv/lib/python3.10/site-packages/httpx/_client.py", line 1719, in _send_single_request
    response = await transport.handle_async_request(request)
  File "/opt/pysetup/.venv/lib/python3.10/site-packages/httpx/_transports/default.py", line 352, in handle_async_request
    with map_httpcore_exceptions():
  File "/usr/local/lib/python3.10/contextlib.py", line 153, in __exit__
    self.gen.throw(typ, value, traceback)
  File "/opt/pysetup/.venv/lib/python3.10/site-packages/httpx/_transports/default.py", line 77, in map_httpcore_exceptions
    raise mapped_exc(message) from exc
httpx.ConnectTimeout
INFO: 05-Dec-23 16:22:19 	original.jpg minified
INFO: 05-Dec-23 16:22:19 	Tiny image saved
INFO: 05-Dec-23 16:22:19 	HTTP Request: GET https://www.hap-en-tap.be/wp-content/uploads/2019/11/Kroketjes-FT.jpg "HTTP/1.1 200 OK"
INFO: 05-Dec-23 16:22:19 	HTTP Request: GET https://metvijfaantafel.be/wp-content/uploads/2023/05/Alles-in-een-pan-tortellini-met-Italiaanse-balletjes-en-burrata.jpg "HTTP/1.1 200 OK"
INFO: 05-Dec-23 16:22:19 	HTTP Request: GET https://www.laurasbakery.nl/wp-content/smush-webp/2019/10/mokkacreme-uitgelicht.jpg.webp "HTTP/1.1 200 OK"
INFO: 05-Dec-23 16:22:19 	HTTP Request: GET https://www.hap-en-tap.be/wp-content/uploads/2019/02/Koffiecakejes-1-FT.jpg "HTTP/1.1 200 OK"
INFO: 05-Dec-23 16:22:19 	HTTP Request: GET https://metvijfaantafel.be/wp-content/uploads/2021/06/Spaghetti-met-Italiaanse-balletjes-in-tomatensaus.jpg "HTTP/1.1 200 OK"
INFO: 05-Dec-23 16:22:19 	HTTP Request: GET https://www.hap-en-tap.be/wp-content/uploads/2021/04/Taartje-Maja-def-FT.jpg "HTTP/1.1 200 OK"
INFO: 05-Dec-23 16:22:19 	original.jpg minified
INFO: 05-Dec-23 16:22:19 	Tiny image saved
INFO: 05-Dec-23 16:22:19 	HTTP Request: GET https://mykoreankitchen.com/wp-content/uploads/2013/07/1.Korean-mixed-rice-Bibimbap.jpg "HTTP/1.1 200 OK"
INFO: 05-Dec-23 16:22:19 	HTTP Request: GET https://image.15gram.be/uploads/recipes/4679_panna-cotta_1471939742-1920x1280.jpg "HTTP/1.1 200 OK"
INFO: 05-Dec-23 16:22:20 	original.jpg minified
INFO: 05-Dec-23 16:22:20 	Tiny image saved
INFO: 05-Dec-23 16:22:20 	original.jpg minified
INFO: 05-Dec-23 16:22:20 	Tiny image saved
INFO: 05-Dec-23 16:22:20 	original.jpg minified
INFO: 05-Dec-23 16:22:20 	Tiny image saved
INFO: 05-Dec-23 16:22:20 	original.jpg minified
INFO: 05-Dec-23 16:22:20 	Tiny image saved
INFO: 05-Dec-23 16:22:21 	original.jpg minified
INFO: 05-Dec-23 16:22:21 	Tiny image saved
INFO: 05-Dec-23 16:22:21 	original.jpg minified
INFO: 05-Dec-23 16:22:21 	Tiny image saved
INFO: 05-Dec-23 16:22:21 	original.jpg minified
INFO: 05-Dec-23 16:22:21 	Tiny image saved
INFO: 05-Dec-23 16:39:33 	Database connection established.
INFO: 05-Dec-23 16:39:33 	Context impl PostgresqlImpl.
INFO: 05-Dec-23 16:39:33 	Will assume transactional DDL.
WARNING: 05-Dec-23 16:39:33 	"get_all" method is deprecated; use "page_all" instead
INFO: 05-Dec-23 16:39:33 	No food found with slug: 'dairy-products-and-dairy-substitutes' skipping fix
INFO: 05-Dec-23 16:39:37 	-----SYSTEM STARTUP----- 

INFO: 05-Dec-23 16:39:37 	------APP SETTINGS------
INFO: 05-Dec-23 16:39:37 	{
    "theme": {
        "light_primary": "#E58325",
        "light_accent": "#007A99",
        "light_secondary": "#973542",
        "light_success": "#43A047",
        "light_info": "#1976D2",
        "light_warning": "#FF6D00",
        "light_error": "#EF5350",
        "dark_primary": "#E58325",
        "dark_accent": "#007A99",
        "dark_secondary": "#973542",
        "dark_success": "#43A047",
        "dark_info": "#1976D2",
        "dark_warning": "#FF6D00",
        "dark_error": "#EF5350"
    },
    "PRODUCTION": true,
    "BASE_URL": "https://mealie.borri.click",
    "STATIC_FILES": "/spa/static",
    "IS_DEMO": false,
    "API_PORT": 10018,
    "API_DOCS": true,
    "TOKEN_TIME": 48,
    "LOG_LEVEL": "INFO",
    "GIT_COMMIT_HASH": "c9852daf0e213dc4cadf97971c7787cf6fc66dfc",
    "ALLOW_SIGNUP": true,
    "SECURITY_MAX_LOGIN_ATTEMPTS": 5,
    "SECURITY_USER_LOCKOUT_TIME": 24,
    "DB_ENGINE": "postgres",
    "DEFAULT_GROUP": "Home",
    "SMTP_HOST": null,
    "SMTP_PORT": "587",
    "SMTP_FROM_NAME": "Mealie",
    "SMTP_FROM_EMAIL": null,
    "SMTP_AUTH_STRATEGY": "TLS",
    "LDAP_AUTH_ENABLED": false,
    "LDAP_SERVER_URL": null,
    "LDAP_TLS_INSECURE": false,
    "LDAP_TLS_CACERTFILE": null,
    "LDAP_ENABLE_STARTTLS": false,
    "LDAP_BASE_DN": null,
    "LDAP_QUERY_BIND": null,
    "LDAP_QUERY_PASSWORD": null,
    "LDAP_USER_FILTER": null,
    "LDAP_ADMIN_FILTER": null,
    "LDAP_ID_ATTRIBUTE": "uid",
    "LDAP_MAIL_ATTRIBUTE": "mail",
    "LDAP_NAME_ATTRIBUTE": "name",
    "TESTING": false
}
INFO: 05-Dec-23 16:44:06 	HTTP Request: GET https://caiorss.github.io/bookmarklet-maker/ "HTTP/1.1 200 OK"
ERROR: 05-Dec-23 16:44:06 	Recipe Scraper was unable to extract a recipe.
INFO: 05-Dec-23 16:44:06 	HTTP Request: GET https://caiorss.github.io/bookmarklet-maker/ "HTTP/1.1 200 OK"
INFO: 05-Dec-23 16:44:16 	HTTP Request: GET https://www.google.com/?client=safari "HTTP/1.1 200 OK"
ERROR: 05-Dec-23 16:44:16 	Recipe Scraper was unable to extract a recipe.
INFO: 05-Dec-23 16:44:16 	HTTP Request: GET https://www.google.com/?client=safari "HTTP/1.1 200 OK"
INFO: 05-Dec-23 16:46:07 	HTTP Request: GET https://www.google.com/search?q=add%20bookmarklet%20to%20safari "HTTP/1.1 200 OK"
ERROR: 05-Dec-23 16:46:07 	Recipe Scraper was unable to extract a recipe.
INFO: 05-Dec-23 16:46:07 	HTTP Request: GET https://www.google.com/search?q=add%20bookmarklet%20to%20safari "HTTP/1.1 200 OK"
INFO: 05-Dec-23 16:46:25 	HTTP Request: GET https://www.hap-en-tap.be/tricolore-opgerolde-pannenkoekjes-met-parmaham/ "HTTP/1.1 200 OK"
ERROR: 05-Dec-23 16:46:26 	Recipe Scraper was unable to extract a recipe.
INFO: 05-Dec-23 16:46:27 	HTTP Request: GET https://www.hap-en-tap.be/tricolore-opgerolde-pannenkoekjes-met-parmaham/ "HTTP/1.1 200 OK"
INFO: 05-Dec-23 16:46:27 	Image URL: https://www.hap-en-tap.be/wp-content/uploads/2020/07/Parmaham-FT.jpg
INFO: 05-Dec-23 16:46:27 	HTTP Request: GET https://www.hap-en-tap.be/wp-content/uploads/2020/07/Parmaham-FT.jpg "HTTP/1.1 200 OK"
INFO: 05-Dec-23 16:46:27 	original.jpg minified
INFO: 05-Dec-23 16:46:27 	Tiny image saved
INFO: 05-Dec-23 16:49:16 	Seeding Ingredient Foods
INFO: 05-Dec-23 16:49:25 	Seeding Ingredient Units
INFO: 05-Dec-23 16:49:34 	Seeding MultiPurposeLabel
INFO: 05-Dec-23 16:51:41 	HTTP Request: GET https://www.hellofresh.be/recipes/wildzwijnburger-met-ovenfrietjes-en-rodekool-appelsalade-5dc5419dc6696230d0459a40 "HTTP/1.1 200 OK"
INFO: 05-Dec-23 16:51:41 	Image URL: ['https://img.hellofresh.com/f_auto,fl_lossy,h_640,q_auto,w_1200/hellofresh_s3/image/wildzwijnburger-met-ovenfrietjes-en-rodekool-appelsalade-8aa73c98.jpg']
INFO: 05-Dec-23 16:51:41 	HTTP Request: HEAD https://img.hellofresh.com/f_auto,fl_lossy,h_640,q_auto,w_1200/hellofresh_s3/image/wildzwijnburger-met-ovenfrietjes-en-rodekool-appelsalade-8aa73c98.jpg "HTTP/1.1 200 OK"
INFO: 05-Dec-23 16:51:41 	HTTP Request: GET https://img.hellofresh.com/f_auto,fl_lossy,h_640,q_auto,w_1200/hellofresh_s3/image/wildzwijnburger-met-ovenfrietjes-en-rodekool-appelsalade-8aa73c98.jpg "HTTP/1.1 200 OK"
INFO: 05-Dec-23 16:51:41 	original.jpg minified
INFO: 05-Dec-23 16:51:41 	Tiny image saved
INFO: 05-Dec-23 16:56:52 	HTTP Request: GET https://www.hellofresh.be/recipes/zelfgemaakte-worstenbroodjes-5e78dcf665cf3542eb46577b "HTTP/1.1 200 OK"
INFO: 05-Dec-23 16:56:52 	Image URL: ['https://img.hellofresh.com/f_auto,fl_lossy,h_640,q_auto,w_1200/hellofresh_s3/image/HF200313_R23_W16_NL_R2226-1_main_low-3415f079.jpg']
INFO: 05-Dec-23 16:56:52 	HTTP Request: HEAD https://img.hellofresh.com/f_auto,fl_lossy,h_640,q_auto,w_1200/hellofresh_s3/image/HF200313_R23_W16_NL_R2226-1_main_low-3415f079.jpg "HTTP/1.1 200 OK"
INFO: 05-Dec-23 16:56:52 	HTTP Request: GET https://img.hellofresh.com/f_auto,fl_lossy,h_640,q_auto,w_1200/hellofresh_s3/image/HF200313_R23_W16_NL_R2226-1_main_low-3415f079.jpg "HTTP/1.1 200 OK"
INFO: 05-Dec-23 16:56:52 	original.jpg minified
INFO: 05-Dec-23 16:56:52 	Tiny image saved
INFO: 05-Dec-23 17:39:37 	locked users reset
INFO: 05-Dec-23 18:39:37 	locked users reset
INFO: 05-Dec-23 19:39:37 	locked users reset
INFO: 05-Dec-23 20:39:37 	locked users reset
INFO: 05-Dec-23 21:39:37 	locked users reset
INFO: 05-Dec-23 22:39:37 	locked users reset
INFO: 05-Dec-23 23:39:37 	locked users reset
INFO: 06-Dec-23 00:39:37 	locked users reset
INFO: 06-Dec-23 01:39:37 	locked users reset
INFO: 06-Dec-23 02:39:37 	locked users reset
INFO: 06-Dec-23 03:39:37 	locked users reset
INFO: 06-Dec-23 04:39:37 	locked users reset
INFO: 06-Dec-23 05:39:37 	locked users reset
INFO: 06-Dec-23 06:39:37 	locked users reset
INFO: 06-Dec-23 07:39:37 	locked users reset
INFO: 06-Dec-23 08:39:37 	locked users reset
INFO: 06-Dec-23 09:39:37 	locked users reset
INFO: 06-Dec-23 10:39:37 	locked users reset
INFO: 06-Dec-23 11:39:37 	locked users reset
INFO: 06-Dec-23 12:39:37 	locked users reset
INFO: 06-Dec-23 13:39:37 	locked users reset
INFO: 06-Dec-23 14:39:37 	locked users reset
INFO: 06-Dec-23 15:39:37 	locked users reset
INFO: 06-Dec-23 16:39:37 	registration token purged
INFO: 06-Dec-23 16:39:37 	password reset tokens purged
ERROR: 06-Dec-23 16:39:37 	Error in scheduled task func='purge_group_data_exports': exception='(psycopg2.errors.UndefinedFunction) operator does not exist: character varying <= timestamp without time zone
LINE 3: WHERE group_data_exports.expires <= '2023-12-05T16:39:37.647...
                                         ^
HINT:  No operator matches the given name and argument types. You might need to add explicit type casts.

[SQL: SELECT group_data_exports.id, group_data_exports.group_id, group_data_exports.name, group_data_exports.filename, group_data_exports.path, group_data_exports.size, group_data_exports.expires, group_data_exports.created_at, group_data_exports.update_at 
FROM group_data_exports 
WHERE group_data_exports.expires <= %(expires_1)s]
[parameters: {'expires_1': datetime.datetime(2023, 12, 5, 16, 39, 37, 647058)}]
(Background on this error at: https://sqlalche.me/e/20/f405)'
INFO: 06-Dec-23 16:39:37 	locked users reset
INFO: 06-Dec-23 17:39:37 	locked users reset
INFO: 06-Dec-23 18:39:37 	locked users reset
INFO: 06-Dec-23 19:39:37 	locked users reset
INFO: 06-Dec-23 20:39:37 	locked users reset
INFO: 06-Dec-23 21:39:37 	locked users reset
INFO: 06-Dec-23 22:06:14 	HTTP Request: GET https://www.allrecipes.com/recipe/229826/perfect-crab-stuffed-mushrooms/ "HTTP/1.1 200 OK"
INFO: 06-Dec-23 22:06:14 	HTTP Request: GET https://www.allrecipes.com/recipe/212940/chicken-arroz-caldo-chicken-rice-porridge/ "HTTP/1.1 200 OK"
INFO: 06-Dec-23 22:06:14 	HTTP Request: GET https://www.allrecipes.com/recipe/86047/garlic-chicken-fried-chicken/ "HTTP/1.1 200 OK"
INFO: 06-Dec-23 22:06:14 	HTTP Request: GET https://www.allrecipes.com/recipe/16573/chicken-fried-chicken/ "HTTP/1.1 200 OK"
INFO: 06-Dec-23 22:06:14 	HTTP Request: GET https://www.allrecipes.com/recipe/45957/chicken-makhani-indian-butter-chicken/ "HTTP/1.1 200 OK"
INFO: 06-Dec-23 22:06:14 	HTTP Request: GET https://www.allrecipes.com/recipe/24782/makhani-chicken-indian-butter-chicken/ "HTTP/1.1 200 OK"
INFO: 06-Dec-23 22:06:14 	HTTP Request: GET https://www.allrecipes.com/recipe/22737/chicken-enchiladas-v/ "HTTP/1.1 200 OK"
INFO: 06-Dec-23 22:06:14 	HTTP Request: GET https://www.allrecipes.com/recipe/44187/coquito/ "HTTP/1.1 200 OK"
INFO: 06-Dec-23 22:06:14 	HTTP Request: GET https://www.allrecipes.com/recipe/8499/basic-chicken-salad/ "HTTP/1.1 200 OK"
INFO: 06-Dec-23 22:06:14 	HTTP Request: GET https://www.allrecipes.com/bacon-wrapped-dates-with-goat-cheese-recipe-8367330 "HTTP/1.1 200 OK"
INFO: 06-Dec-23 22:06:14 	HTTP Request: GET https://www.allrecipes.com/recipe/216756/baked-ham-and-cheese-party-sandwiches/ "HTTP/1.1 200 OK"
INFO: 06-Dec-23 22:06:14 	HTTP Request: GET https://www.allrecipes.com/recipe/254804/chef-johns-nashville-hot-chicken/ "HTTP/1.1 200 OK"
INFO: 06-Dec-23 22:06:14 	HTTP Request: GET https://www.allrecipes.com/recipe/8495/chicken-cordon-bleu-i/ "HTTP/1.1 200 OK"
INFO: 06-Dec-23 22:06:14 	HTTP Request: GET https://www.allrecipes.com/recipe/244950/baked-chicken-schnitzel/ "HTTP/1.1 200 OK"
INFO: 06-Dec-23 22:06:15 	Image URL: ['https://www.allrecipes.com/thmb/3jOBPlxaE4sYurPR0RYgfF2qX04=/1500x0/filters:no_upscale():max_bytes(150000):strip_icc()/8461820-chicken-enchiladas-v-Henchman-Hunter-4x3-1-5a2370a531ca4c0a8b44943865434a38.jpg']
INFO: 06-Dec-23 22:06:15 	HTTP Request: GET https://www.allrecipes.com/recipe/216564/swedish-meatballs-svenska-kottbullar/ "HTTP/1.1 200 OK"
INFO: 06-Dec-23 22:06:15 	Image URL: ['https://www.allrecipes.com/thmb/4grl4EQdsIYgBxzxzZcTwKMYxIs=/1500x0/filters:no_upscale():max_bytes(150000):strip_icc()/6512910-02568b8eea414fff9d49f500458faaf3.jpg']
INFO: 06-Dec-23 22:06:15 	Image URL: ['https://www.allrecipes.com/thmb/5HglrNLUT16KFaiEe1mlQYWN-Mc=/1500x0/filters:no_upscale():max_bytes(150000):strip_icc()/8495-chicken-cordon-bleu-i-DDMFS-4x3-7dc7fc3c6c37438badf35f188172bd09.jpg']
INFO: 06-Dec-23 22:06:15 	Image URL: ['https://www.allrecipes.com/thmb/AalxQlIAcGzwyONFjXzAzCtho6o=/1500x0/filters:no_upscale():max_bytes(150000):strip_icc()/8349113-garlic-chicken-fried-chicken-Tacita-Lady_T-Beautiful-1x1-1-434fa1b59efc48db9a0a351322e3f45a.jpg']
INFO: 06-Dec-23 22:06:15 	Image URL: ['https://www.allrecipes.com/thmb/-C0seWVNoysl7wjBhyPXxlKhRvU=/1500x0/filters:no_upscale():max_bytes(150000):strip_icc()/8499-basic-chicken-salad-DDMFS-4x3-1edf4d259ac9437da114bdcee84337ee.jpg']
INFO: 06-Dec-23 22:06:16 	Image URL: ['https://www.allrecipes.com/thmb/UB91VMUuh1pvgCrwb2Ls8jLfhn8=/1500x0/filters:no_upscale():max_bytes(150000):strip_icc()/5939577-perfect-crab-stuffed-mushrooms-Mackenzie-Schieck-4x3-1-6715b79239274a5e99c473f8d397814f.jpg']
INFO: 06-Dec-23 22:06:16 	Image URL: ['https://www.allrecipes.com/thmb/ov65yUQ7e7ZNBaMtlVTOQYdM_ls=/1500x0/filters:no_upscale():max_bytes(150000):strip_icc()/3651781-810e0b61706349279c2fe7d7eca7363e.jpg']
INFO: 06-Dec-23 22:06:16 	Image URL: ['https://www.allrecipes.com/thmb/QF7KADg58x9wVQcSjVBsOk9pDEI=/1500x0/filters:no_upscale():max_bytes(150000):strip_icc()/216564-swedish-meatballs-svenska-kottbullar-DDMFS-4x3-2cfaeac162c9485dbd7d632fd0b6ef0a.jpg']
INFO: 06-Dec-23 22:06:16 	HTTP Request: GET https://www.allrecipes.com/recipe/235052/moms-potato-latkes/ "HTTP/1.1 200 OK"
INFO: 06-Dec-23 22:06:16 	Image URL: ['https://www.allrecipes.com/thmb/z_UH9CRADspAEAdhRa-mXa_xLd0=/1500x0/filters:no_upscale():max_bytes(150000):strip_icc()/8367330_Bacon-Wrapped-Dates-with-GoatCheese_France-C_4x3-593a152bdfd4452289a6e979ed4b771c.jpg']
INFO: 06-Dec-23 22:06:16 	Image URL: ['https://www.allrecipes.com/thmb/Icn_f4w0fMLbRrV78v8bMSkwfhs=/1500x0/filters:no_upscale():max_bytes(150000):strip_icc()/45957-ChickenMakhaniIndianButterChicken-mfs-4X3-0037-7aa9a555bf3943baae20c5c3b0921375.jpg']
INFO: 06-Dec-23 22:06:16 	Image URL: ['https://www.allrecipes.com/thmb/v0KF7LJuSsRiA3bc7sYJ2V3bwV8=/1500x0/filters:no_upscale():max_bytes(150000):strip_icc()/254804-chef-johns-nashville-hot-chicken-DDMFS-4x3-c1192bac5dfc43bba55056a33a17153f.jpg']
INFO: 06-Dec-23 22:06:16 	Image URL: ['https://www.allrecipes.com/thmb/4TAN4PhYNTiegIQ7CBEzh5UmxRo=/1500x0/filters:no_upscale():max_bytes(150000):strip_icc()/1423828-moms-potato-latkes-Holiday-Baker-1x1-1-b1c132698dfa4d3b8c299f8e611b3906.jpg']
INFO: 06-Dec-23 22:06:17 	HTTP Request: HEAD https://www.allrecipes.com/thmb/4grl4EQdsIYgBxzxzZcTwKMYxIs=/1500x0/filters:no_upscale():max_bytes(150000):strip_icc()/6512910-02568b8eea414fff9d49f500458faaf3.jpg "HTTP/1.1 200 OK"
INFO: 06-Dec-23 22:06:17 	HTTP Request: HEAD https://www.allrecipes.com/thmb/5HglrNLUT16KFaiEe1mlQYWN-Mc=/1500x0/filters:no_upscale():max_bytes(150000):strip_icc()/8495-chicken-cordon-bleu-i-DDMFS-4x3-7dc7fc3c6c37438badf35f188172bd09.jpg "HTTP/1.1 200 OK"
INFO: 06-Dec-23 22:06:17 	Image URL: ['https://www.allrecipes.com/thmb/n5TbAYtBLCU3cVk0LfApLts10Z0=/1500x0/filters:no_upscale():max_bytes(150000):strip_icc()/244950-baked-chicken-schnitzel-step-4-35-eb70480d775c4f0eb97309eb4107da32.jpg']
INFO: 06-Dec-23 22:06:17 	Image URL: ['https://www.allrecipes.com/thmb/gS3yT_9t9TxTUpQHYq0wZK1k0cc=/1500x0/filters:no_upscale():max_bytes(150000):strip_icc()/5830864-makhani-chicken-indian-butter-chicken-MotherSarah-1x1-1-b2c237f4a9d243899dd082de108a65fe.jpg']
INFO: 06-Dec-23 22:06:17 	HTTP Request: HEAD https://www.allrecipes.com/thmb/UB91VMUuh1pvgCrwb2Ls8jLfhn8=/1500x0/filters:no_upscale():max_bytes(150000):strip_icc()/5939577-perfect-crab-stuffed-mushrooms-Mackenzie-Schieck-4x3-1-6715b79239274a5e99c473f8d397814f.jpg "HTTP/1.1 200 OK"
INFO: 06-Dec-23 22:06:17 	HTTP Request: HEAD https://www.allrecipes.com/thmb/QF7KADg58x9wVQcSjVBsOk9pDEI=/1500x0/filters:no_upscale():max_bytes(150000):strip_icc()/216564-swedish-meatballs-svenska-kottbullar-DDMFS-4x3-2cfaeac162c9485dbd7d632fd0b6ef0a.jpg "HTTP/1.1 200 OK"
INFO: 06-Dec-23 22:06:17 	Image URL: ['https://www.allrecipes.com/thmb/J5Xqu5mA4P2Q68aThs74VJlQ30A=/1500x0/filters:no_upscale():max_bytes(150000):strip_icc()/44187-coquito-vat-4X3-1-8bf148c0ff1a4a5b88660a66c28aa05d.jpg']
INFO: 06-Dec-23 22:06:17 	Image URL: ['https://www.allrecipes.com/thmb/aS_TDCGizKGfO6fMJ7jQedoP31U=/1500x0/filters:no_upscale():max_bytes(150000):strip_icc()/216756-Baked-Ham-And-Cheese-Party-Sandwiches-mfs_001-4x3-931c71f723a14e26a6f11dea7fdc3f8c.jpg']
INFO: 06-Dec-23 22:06:17 	HTTP Request: HEAD https://www.allrecipes.com/thmb/z_UH9CRADspAEAdhRa-mXa_xLd0=/1500x0/filters:no_upscale():max_bytes(150000):strip_icc()/8367330_Bacon-Wrapped-Dates-with-GoatCheese_France-C_4x3-593a152bdfd4452289a6e979ed4b771c.jpg "HTTP/1.1 200 OK"
INFO: 06-Dec-23 22:06:17 	HTTP Request: HEAD https://www.allrecipes.com/thmb/3jOBPlxaE4sYurPR0RYgfF2qX04=/1500x0/filters:no_upscale():max_bytes(150000):strip_icc()/8461820-chicken-enchiladas-v-Henchman-Hunter-4x3-1-5a2370a531ca4c0a8b44943865434a38.jpg "HTTP/1.1 200 OK"
INFO: 06-Dec-23 22:06:17 	HTTP Request: GET https://www.allrecipes.com/thmb/4grl4EQdsIYgBxzxzZcTwKMYxIs=/1500x0/filters:no_upscale():max_bytes(150000):strip_icc()/6512910-02568b8eea414fff9d49f500458faaf3.jpg "HTTP/1.1 200 OK"
INFO: 06-Dec-23 22:06:17 	HTTP Request: GET https://www.allrecipes.com/thmb/5HglrNLUT16KFaiEe1mlQYWN-Mc=/1500x0/filters:no_upscale():max_bytes(150000):strip_icc()/8495-chicken-cordon-bleu-i-DDMFS-4x3-7dc7fc3c6c37438badf35f188172bd09.jpg "HTTP/1.1 200 OK"
INFO: 06-Dec-23 22:06:18 	HTTP Request: GET https://www.allrecipes.com/thmb/QF7KADg58x9wVQcSjVBsOk9pDEI=/1500x0/filters:no_upscale():max_bytes(150000):strip_icc()/216564-swedish-meatballs-svenska-kottbullar-DDMFS-4x3-2cfaeac162c9485dbd7d632fd0b6ef0a.jpg "HTTP/1.1 200 OK"
INFO: 06-Dec-23 22:06:18 	HTTP Request: GET https://www.allrecipes.com/thmb/UB91VMUuh1pvgCrwb2Ls8jLfhn8=/1500x0/filters:no_upscale():max_bytes(150000):strip_icc()/5939577-perfect-crab-stuffed-mushrooms-Mackenzie-Schieck-4x3-1-6715b79239274a5e99c473f8d397814f.jpg "HTTP/1.1 200 OK"
INFO: 06-Dec-23 22:06:18 	HTTP Request: GET https://www.allrecipes.com/thmb/z_UH9CRADspAEAdhRa-mXa_xLd0=/1500x0/filters:no_upscale():max_bytes(150000):strip_icc()/8367330_Bacon-Wrapped-Dates-with-GoatCheese_France-C_4x3-593a152bdfd4452289a6e979ed4b771c.jpg "HTTP/1.1 200 OK"
INFO: 06-Dec-23 22:06:18 	HTTP Request: GET https://www.allrecipes.com/thmb/3jOBPlxaE4sYurPR0RYgfF2qX04=/1500x0/filters:no_upscale():max_bytes(150000):strip_icc()/8461820-chicken-enchiladas-v-Henchman-Hunter-4x3-1-5a2370a531ca4c0a8b44943865434a38.jpg "HTTP/1.1 200 OK"
INFO: 06-Dec-23 22:06:18 	original.jpg minified
INFO: 06-Dec-23 22:06:18 	Tiny image saved
INFO: 06-Dec-23 22:06:18 	HTTP Request: HEAD https://www.allrecipes.com/thmb/n5TbAYtBLCU3cVk0LfApLts10Z0=/1500x0/filters:no_upscale():max_bytes(150000):strip_icc()/244950-baked-chicken-schnitzel-step-4-35-eb70480d775c4f0eb97309eb4107da32.jpg "HTTP/1.1 200 OK"
INFO: 06-Dec-23 22:06:18 	HTTP Request: HEAD https://www.allrecipes.com/thmb/aS_TDCGizKGfO6fMJ7jQedoP31U=/1500x0/filters:no_upscale():max_bytes(150000):strip_icc()/216756-Baked-Ham-And-Cheese-Party-Sandwiches-mfs_001-4x3-931c71f723a14e26a6f11dea7fdc3f8c.jpg "HTTP/1.1 200 OK"
INFO: 06-Dec-23 22:06:18 	HTTP Request: HEAD https://www.allrecipes.com/thmb/gS3yT_9t9TxTUpQHYq0wZK1k0cc=/1500x0/filters:no_upscale():max_bytes(150000):strip_icc()/5830864-makhani-chicken-indian-butter-chicken-MotherSarah-1x1-1-b2c237f4a9d243899dd082de108a65fe.jpg "HTTP/1.1 200 OK"
INFO: 06-Dec-23 22:06:18 	HTTP Request: HEAD https://www.allrecipes.com/thmb/J5Xqu5mA4P2Q68aThs74VJlQ30A=/1500x0/filters:no_upscale():max_bytes(150000):strip_icc()/44187-coquito-vat-4X3-1-8bf148c0ff1a4a5b88660a66c28aa05d.jpg "HTTP/1.1 200 OK"
INFO: 06-Dec-23 22:06:18 	HTTP Request: HEAD https://www.allrecipes.com/thmb/ov65yUQ7e7ZNBaMtlVTOQYdM_ls=/1500x0/filters:no_upscale():max_bytes(150000):strip_icc()/3651781-810e0b61706349279c2fe7d7eca7363e.jpg "HTTP/1.1 200 OK"
INFO: 06-Dec-23 22:06:18 	original.jpg minified
INFO: 06-Dec-23 22:06:18 	Tiny image saved
INFO: 06-Dec-23 22:06:19 	original.jpg minified
INFO: 06-Dec-23 22:06:19 	Tiny image saved
INFO: 06-Dec-23 22:06:19 	HTTP Request: HEAD https://www.allrecipes.com/thmb/Icn_f4w0fMLbRrV78v8bMSkwfhs=/1500x0/filters:no_upscale():max_bytes(150000):strip_icc()/45957-ChickenMakhaniIndianButterChicken-mfs-4X3-0037-7aa9a555bf3943baae20c5c3b0921375.jpg "HTTP/1.1 200 OK"
INFO: 06-Dec-23 22:06:19 	HTTP Request: HEAD https://www.allrecipes.com/thmb/4TAN4PhYNTiegIQ7CBEzh5UmxRo=/1500x0/filters:no_upscale():max_bytes(150000):strip_icc()/1423828-moms-potato-latkes-Holiday-Baker-1x1-1-b1c132698dfa4d3b8c299f8e611b3906.jpg "HTTP/1.1 200 OK"
INFO: 06-Dec-23 22:06:19 	HTTP Request: HEAD https://www.allrecipes.com/thmb/-C0seWVNoysl7wjBhyPXxlKhRvU=/1500x0/filters:no_upscale():max_bytes(150000):strip_icc()/8499-basic-chicken-salad-DDMFS-4x3-1edf4d259ac9437da114bdcee84337ee.jpg "HTTP/1.1 200 OK"
INFO: 06-Dec-23 22:06:19 	original.jpg minified
INFO: 06-Dec-23 22:06:19 	Tiny image saved
INFO: 06-Dec-23 22:06:20 	original.jpg minified
INFO: 06-Dec-23 22:06:20 	Tiny image saved
INFO: 06-Dec-23 22:06:20 	original.jpg minified
INFO: 06-Dec-23 22:06:20 	Tiny image saved
INFO: 06-Dec-23 22:06:20 	HTTP Request: HEAD https://www.allrecipes.com/thmb/AalxQlIAcGzwyONFjXzAzCtho6o=/1500x0/filters:no_upscale():max_bytes(150000):strip_icc()/8349113-garlic-chicken-fried-chicken-Tacita-Lady_T-Beautiful-1x1-1-434fa1b59efc48db9a0a351322e3f45a.jpg "HTTP/1.1 200 OK"
INFO: 06-Dec-23 22:06:20 	HTTP Request: HEAD https://www.allrecipes.com/thmb/v0KF7LJuSsRiA3bc7sYJ2V3bwV8=/1500x0/filters:no_upscale():max_bytes(150000):strip_icc()/254804-chef-johns-nashville-hot-chicken-DDMFS-4x3-c1192bac5dfc43bba55056a33a17153f.jpg "HTTP/1.1 200 OK"
INFO: 06-Dec-23 22:06:20 	HTTP Request: GET https://www.allrecipes.com/thmb/J5Xqu5mA4P2Q68aThs74VJlQ30A=/1500x0/filters:no_upscale():max_bytes(150000):strip_icc()/44187-coquito-vat-4X3-1-8bf148c0ff1a4a5b88660a66c28aa05d.jpg "HTTP/1.1 200 OK"
INFO: 06-Dec-23 22:06:20 	HTTP Request: GET https://www.allrecipes.com/thmb/ov65yUQ7e7ZNBaMtlVTOQYdM_ls=/1500x0/filters:no_upscale():max_bytes(150000):strip_icc()/3651781-810e0b61706349279c2fe7d7eca7363e.jpg "HTTP/1.1 200 OK"
INFO: 06-Dec-23 22:06:20 	HTTP Request: GET https://www.allrecipes.com/thmb/gS3yT_9t9TxTUpQHYq0wZK1k0cc=/1500x0/filters:no_upscale():max_bytes(150000):strip_icc()/5830864-makhani-chicken-indian-butter-chicken-MotherSarah-1x1-1-b2c237f4a9d243899dd082de108a65fe.jpg "HTTP/1.1 200 OK"
INFO: 06-Dec-23 22:06:20 	HTTP Request: GET https://www.allrecipes.com/thmb/n5TbAYtBLCU3cVk0LfApLts10Z0=/1500x0/filters:no_upscale():max_bytes(150000):strip_icc()/244950-baked-chicken-schnitzel-step-4-35-eb70480d775c4f0eb97309eb4107da32.jpg "HTTP/1.1 200 OK"
INFO: 06-Dec-23 22:06:20 	HTTP Request: GET https://www.allrecipes.com/thmb/Icn_f4w0fMLbRrV78v8bMSkwfhs=/1500x0/filters:no_upscale():max_bytes(150000):strip_icc()/45957-ChickenMakhaniIndianButterChicken-mfs-4X3-0037-7aa9a555bf3943baae20c5c3b0921375.jpg "HTTP/1.1 200 OK"
INFO: 06-Dec-23 22:06:20 	HTTP Request: GET https://www.allrecipes.com/thmb/aS_TDCGizKGfO6fMJ7jQedoP31U=/1500x0/filters:no_upscale():max_bytes(150000):strip_icc()/216756-Baked-Ham-And-Cheese-Party-Sandwiches-mfs_001-4x3-931c71f723a14e26a6f11dea7fdc3f8c.jpg "HTTP/1.1 200 OK"
INFO: 06-Dec-23 22:06:21 	original.jpg minified
INFO: 06-Dec-23 22:06:21 	Tiny image saved
INFO: 06-Dec-23 22:06:21 	original.jpg minified
INFO: 06-Dec-23 22:06:21 	Tiny image saved
INFO: 06-Dec-23 22:06:21 	original.jpg minified
INFO: 06-Dec-23 22:06:21 	Tiny image saved
INFO: 06-Dec-23 22:06:21 	original.jpg minified
INFO: 06-Dec-23 22:06:21 	Tiny image saved
INFO: 06-Dec-23 22:06:22 	original.jpg minified
INFO: 06-Dec-23 22:06:22 	Tiny image saved
INFO: 06-Dec-23 22:06:22 	original.jpg minified
INFO: 06-Dec-23 22:06:22 	Tiny image saved
INFO: 06-Dec-23 22:06:22 	HTTP Request: GET https://www.allrecipes.com/thmb/4TAN4PhYNTiegIQ7CBEzh5UmxRo=/1500x0/filters:no_upscale():max_bytes(150000):strip_icc()/1423828-moms-potato-latkes-Holiday-Baker-1x1-1-b1c132698dfa4d3b8c299f8e611b3906.jpg "HTTP/1.1 200 OK"
INFO: 06-Dec-23 22:06:22 	HTTP Request: GET https://www.allrecipes.com/thmb/AalxQlIAcGzwyONFjXzAzCtho6o=/1500x0/filters:no_upscale():max_bytes(150000):strip_icc()/8349113-garlic-chicken-fried-chicken-Tacita-Lady_T-Beautiful-1x1-1-434fa1b59efc48db9a0a351322e3f45a.jpg "HTTP/1.1 200 OK"
INFO: 06-Dec-23 22:06:22 	HTTP Request: GET https://www.allrecipes.com/thmb/v0KF7LJuSsRiA3bc7sYJ2V3bwV8=/1500x0/filters:no_upscale():max_bytes(150000):strip_icc()/254804-chef-johns-nashville-hot-chicken-DDMFS-4x3-c1192bac5dfc43bba55056a33a17153f.jpg "HTTP/1.1 200 OK"
INFO: 06-Dec-23 22:06:22 	HTTP Request: GET https://www.allrecipes.com/thmb/-C0seWVNoysl7wjBhyPXxlKhRvU=/1500x0/filters:no_upscale():max_bytes(150000):strip_icc()/8499-basic-chicken-salad-DDMFS-4x3-1edf4d259ac9437da114bdcee84337ee.jpg "HTTP/1.1 200 OK"
INFO: 06-Dec-23 22:06:22 	original.jpg minified
INFO: 06-Dec-23 22:06:22 	Tiny image saved
INFO: 06-Dec-23 22:06:23 	original.jpg minified
INFO: 06-Dec-23 22:06:23 	Tiny image saved
INFO: 06-Dec-23 22:06:23 	original.jpg minified
INFO: 06-Dec-23 22:06:23 	Tiny image saved
INFO: 06-Dec-23 22:06:24 	original.jpg minified
INFO: 06-Dec-23 22:06:24 	Tiny image saved

@michael-genson
Copy link
Collaborator

Yup, can reproduce with your recipe list, it's causing a mess of errors haha. Looks like the issue is mostly that the bulk import isn't fault tolerant, so when it hits certain errors it just dies

@zierbeek
Copy link
Contributor Author

zierbeek commented Dec 6, 2023

Thanks for confirming!

@dfinley
Copy link

dfinley commented Dec 6, 2023

@michael-genson
Copy link
Collaborator

I checked those, looks like eatwell101 doesn't properly expose their recipe data, so we can't scrape it.

I did, however, run it through my PR and it behaves as expected (all recipes fail but the report doesn't fail)

@dfinley
Copy link

dfinley commented Dec 7, 2023 via email

@michael-genson
Copy link
Collaborator

The 301 is just saying it's been relocated, but you should see 200 requests following the 301's

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug: confirmed bug Something isn't working
Projects
None yet
Development

Successfully merging a pull request may close this issue.

3 participants