Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add scripts\in_container folder when all other sources are removed. #36129

Merged

Conversation

potiuk
Copy link
Member

@potiuk potiuk commented Dec 8, 2023

This allows to tests the scripts that require --mount-sources remove but you run some scripts inside the container (for example this was the case when modifying installation of airflow and providers to be run in Python in #36094. In order to debug those, image needed to be rebuild to run the "in-container" scripts..

More importantly - users will also have to rebuild the image after they rebase to latest main - in order to use the new scripts when runinng --use-airflow-version.

This change will make the modification coming from main visible in
their images even without rebuilding the image.


^ Add meaningful description above
Read the Pull Request Guidelines for more information.
In case of fundamental code changes, an Airflow Improvement Proposal (AIP) is needed.
In case of a new dependency, check compliance with the ASF 3rd Party License Policy.
In case of backwards incompatible changes please leave a note in a newsfragment file, named {pr_number}.significant.rst or {issue_number}.significant.rst, in newsfragments.

@potiuk potiuk requested a review from ashb as a code owner December 8, 2023 18:13
@potiuk potiuk requested review from vincbeck and Taragolis December 8, 2023 18:13
@potiuk potiuk force-pushed the improve-debugging-for-in-container-scripts branch from 5fb7483 to eb97e1d Compare December 8, 2023 18:16
@potiuk potiuk force-pushed the improve-debugging-for-in-container-scripts branch from eb97e1d to 8b250b8 Compare December 8, 2023 18:29
@potiuk potiuk changed the title Add scripts folder when generally all other sources are removed. Add scripts\in_container folder when all other sources are removed. Dec 8, 2023
@potiuk potiuk force-pushed the improve-debugging-for-in-container-scripts branch from 8b250b8 to 9365a35 Compare December 8, 2023 18:30
This allows to tests the scripts that require --mount-sources remove
but you run some scripts inside the container (for example this
was the case when modifying installation of airflow and
providers to be run in Python in apache#36094. In order to debug those,
The image needed to be rebuild to run the "in-container" scripts..

More importantly - users will also have to rebuild the image after
they rebase to latest main - in order to use the new scripts when
runinng `--use-airflow-version`.

This change will make the modification coming from main visible in
their images even without rebuilding the image.
@potiuk potiuk force-pushed the improve-debugging-for-in-container-scripts branch from 9365a35 to be90bb8 Compare December 8, 2023 18:32
@potiuk potiuk merged commit 67453a6 into apache:main Dec 8, 2023
5 checks passed
@potiuk potiuk deleted the improve-debugging-for-in-container-scripts branch December 8, 2023 18:35
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants