Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

No option to set blocksize when retrieving a file in ftphook #23935

Closed
1 of 2 tasks
yfyg opened this issue May 26, 2022 · 5 comments · Fixed by #24860
Closed
1 of 2 tasks

No option to set blocksize when retrieving a file in ftphook #23935

yfyg opened this issue May 26, 2022 · 5 comments · Fixed by #24860
Assignees
Labels
area:providers contributors-workshop Issues that are good for first-time contributor's workshop good first issue kind:feature Feature Requests

Comments

@yfyg
Copy link

yfyg commented May 26, 2022

Apache Airflow version

2.0.0

What happened

using ftphook, im trying to download a file in chunks but the deafult blocksize is 8192 and cannot be changed.
retrieve_file code is calling conn.retrbinary(f'RETR {remote_file_name}', callback) but no blocksize is passed while this function is declared:
def retrbinary(self, cmd, callback, blocksize=8192, rest=None):

What you think should happen instead

allow passing a blocksize

How to reproduce

No response

Operating System

gcp

Versions of Apache Airflow Providers

No response

Deployment

Docker-Compose

Deployment details

No response

Anything else

No response

Are you willing to submit PR?

  • Yes I am willing to submit a PR!

Code of Conduct

@yfyg yfyg added area:core kind:bug This is a clearly a bug labels May 26, 2022
@boring-cyborg
Copy link

boring-cyborg bot commented May 26, 2022

Thanks for opening your first issue here! Be sure to follow the issue template!

@josh-fell josh-fell added kind:feature Feature Requests good first issue and removed kind:bug This is a clearly a bug labels May 26, 2022
@josh-fell
Copy link
Contributor

@yfyg It seems like you know what the feature implementation should be and can easily test it too. Do you want to submit a PR for this? Airflow has over 2K contributors and we love when new people come onboard!

@eladkal eladkal added area:providers provider:protocols contributors-workshop Issues that are good for first-time contributor's workshop and removed area:core labels May 26, 2022
@kevgeo
Copy link
Contributor

kevgeo commented May 31, 2022

Hi @yfyg, are you working on this issue? If not, @eladkal, @josh-fell, I would love to take up this issue.

@potiuk
Copy link
Member

potiuk commented May 31, 2022

Feel free

@yfyg
Copy link
Author

yfyg commented May 31, 2022 via email

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area:providers contributors-workshop Issues that are good for first-time contributor's workshop good first issue kind:feature Feature Requests
Projects
None yet
Development

Successfully merging a pull request may close this issue.

5 participants