fix: TLS fingerprinting prevents scraping #2888

[bilhert]

What type of PR is this?

• bug

What this PR does / why we need it:

TLS fingerprinting* detection can be used to protect websites from (scraper)bots. Cloudflare provides this service for example**

https://www.ah.nl/allerhande became unavailable since this technique was used. Using a TLS spoofing technique this is countered.
To do so httpx is replaced with curl-cffi (https://pypi.org/project/curl-cffi/0.2.1)

• https://fingerprint.com/blog/what-is-tls-fingerprinting-transport-layer-security/
  ** https://developers.cloudflare.com/bots/concepts/ja3-fingerprint/

Which issue(s) this PR fixes:

fixes #2888

Special notes for your reviewer:

Testing

(fill-in or delete this section)
A docker build was used to build the project. afterwards only the import of recipies from urls was tested using ah.nl/allerhande, lidl-kochen.de and various random other sites.

[bilhert]

Formatting has been fixed by poetry black

[hay-kot]

FYI, we're addressing some security issues in #3368 so once that is merged you'll have some additional work to do here to also address those security issues.

[bilhert]

Thank you for mentioning this. I looked into the PR. unfortunately the chosen method to implement the security fix seems to be incompatible with curl_cffi. I could not find a option that mimics the transport parameter of httpx. Therefore I foresee that the amount of time that I have to invest into setting up a fully equipped dev environment, getting familiar with the project's structure etc. to do the additional work properly is more than I have available at the moment. Thus for now I sadly have to leave this as an example how TLS fingerprints can be spoofed within the project for someone who is more up to speed with the project.