Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Download files with deb/rpm extensions to packages subdirectory (#3015) #3020

Merged
merged 20 commits into from
Mar 22, 2022
Merged

Download files with deb/rpm extensions to packages subdirectory (#3015) #3020

merged 20 commits into from
Mar 22, 2022

Conversation

sbbroot
Copy link
Contributor

@sbbroot sbbroot commented Mar 13, 2022

No description provided.

seriva
seriva previously approved these changes Mar 14, 2022
View reviewed changes
rafzei
rafzei previously approved these changes Mar 14, 2022
View reviewed changes
@przemyslavic
Copy link
Collaborator

/azp run

@azure-pipelines
Copy link

Azure Pipelines successfully started running 1 pipeline(s).

@przemyslavic
Copy link
Collaborator

  1. Duplicate files appear after re-running the download requirements script on RHEL. On Ubuntu there are no duplicate packages, however the files are downloaded again.
2022-03-14 12:13:27,285 [INFO]: Downloading files...
2022-03-14 12:13:27,287 [INFO]: - https://packages.elastic.co/curator/5/debian9/pool/main/e/elasticsearch-curator/elasticsearch-curator_5.8.3_amd64.deb
2022-03-14 12:13:27,287 [DEBUG]: [1/3] Running: wget --no-use-server-timestamps --continue --show-progress --directory-prefix=/shared/build/prepare_scripts_ubuntu_2004_x86_64/down2/packages --prefer-family=IPv4 https://packages.elastic.co/curator/5/debian9/pool/main/e/elasticsearch-curator/elasticsearch-curator_5.8.3_amd64.deb
2022-03-14 12:13:27,990 [INFO]: - https://dl.grafana.com/oss/release/grafana_8.3.2_amd64.deb
2022-03-14 12:13:27,991 [DEBUG]: [1/3] Running: wget --no-use-server-timestamps --continue --show-progress --directory-prefix=/shared/build/prepare_scripts_ubuntu_2004_x86_64/down2/packages --prefer-family=IPv4 https://dl.grafana.com/oss/release/grafana_8.3.2_amd64.deb
2022-03-14 12:13:28,308 [DEBUG]: - https://github.com/danielqsj/kafka_exporter/releases/download/v1.4.0/kafka_exporter-1.4.0.linux-amd64.tar.gz - checksum ok, skipped

2022-03-14 12:08:03,651 [INFO]: Downloading files...
2022-03-14 12:08:03,653 [INFO]: - https://github.com/rabbitmq/erlang-rpm/releases/download/v23.1.5/erlang-23.1.5-1.el7.x86_64.rpm
2022-03-14 12:08:03,654 [DEBUG]: [1/3] Running: wget --directory-prefix=/shared/build/prepare_scripts_redhat_7_x86_64/down2/packages --prefer-family=IPv4 https://github.com/rabbitmq/erlang-rpm/releases/download/v23.1.5/erlang-23.1.5-1.el7.x86_64.rpm
2022-03-14 12:08:05,331 [INFO]: - https://dl.grafana.com/oss/release/grafana-8.3.2-1.x86_64.rpm
2022-03-14 12:08:05,332 [DEBUG]: [1/3] Running: wget --directory-prefix=/shared/build/prepare_scripts_redhat_7_x86_64/down2/packages --prefer-family=IPv4 https://dl.grafana.com/oss/release/grafana-8.3.2-1.x86_64.rpm
2022-03-14 12:08:09,677 [DEBUG]: - https://github.com/danielqsj/kafka_exporter/releases/download/v1.4.0/kafka_exporter-1.4.0.linux-amd64.tar.gz - checksum ok, skipped
2022-03-14 12:08:09,678 [INFO]: Done downloading files.

[root@1d61eda63c7e /]# ls -lah /shared/build/prepare_scripts_redhat_7_x86_64/down2/packages/{grafana,erlang}*
-rw-r--r-- 1 root root 20M Dec  8 03:44 /shared/build/prepare_scripts_redhat_7_x86_64/down2/packages/erlang-23.1.5-1.el7.x86_64.rpm
-rw-r--r-- 1 root root 20M Dec  8 03:44 /shared/build/prepare_scripts_redhat_7_x86_64/down2/packages/erlang-23.1.5-1.el7.x86_64.rpm.1
-rw-r--r-- 1 root root 70M Dec 10 13:43 /shared/build/prepare_scripts_redhat_7_x86_64/down2/packages/grafana-8.3.2-1.x86_64.rpm
-rw-r--r-- 1 root root 70M Dec 10 13:43 /shared/build/prepare_scripts_redhat_7_x86_64/down2/packages/grafana-8.3.2-1.x86_64.rpm.1
  1. Installation of particular components fails as the path to the packages is different:
2022-03-14T12:00:16.4712802Z[38;21m12:00:16 INFO cli.src.ansible.AnsibleCommand - TASK [grafana : Install Grafana with dependencies] *****************************
2022-03-14T12:00:17.6404056Z[31;21m12:00:17 ERROR cli.src.ansible.AnsibleCommand - fatal: [ci-xxxawsubuflannel-monitoring-vm-0]: FAILED! => {"changed": false, "msg": "Failure downloading http://10.1.11.52/epirepo/files/grafana_8.3.2_amd64.deb, HTTP Error 404: Not Found"}

@sbbroot sbbroot dismissed stale reviews from rafzei and seriva via c301f19 March 15, 2022 14:36
@sbbroot sbbroot force-pushed the download-requirements-files-to-packages branch from 7e27a7a to c301f19 Compare March 15, 2022 14:36
@azure-pipelines
Copy link

Azure Pipelines successfully started running 1 pipeline(s).

@przemyslavic
Copy link
Collaborator

/azp run

@azure-pipelines
Copy link

Azure Pipelines successfully started running 1 pipeline(s).

@sbbroot sbbroot force-pushed the download-requirements-files-to-packages branch from 6dbd997 to 2c74d29 Compare March 16, 2022 10:33
@przemyslavic
Copy link
Collaborator

/azp run

@azure-pipelines
Copy link

Azure Pipelines successfully started running 1 pipeline(s).

@przemyslavic
Copy link
Collaborator

/azp run

@azure-pipelines
Copy link

Azure Pipelines successfully started running 1 pipeline(s).

@przemyslavic
Copy link
Collaborator

/azp run

@azure-pipelines
Copy link

Azure Pipelines successfully started running 1 pipeline(s).

@przemyslavic
Copy link
Collaborator

/azp run

@azure-pipelines
Copy link

Azure Pipelines successfully started running 1 pipeline(s).

@przemyslavic
Copy link
Collaborator

It still doesn't work 😢

2022-03-21T14:56:31.9929321Z �[38;21m14:56:31 INFO cli.src.ansible.AnsibleCommand - TASK [elasticsearch_curator : Install elasticsearch-curator package] ***********�[0m 2022-03-21T14:56:33.1261600Z �[31;21m14:56:33 ERROR cli.src.ansible.AnsibleCommand - fatal: [ci-devawsubuflannel-logging-vm-0]: FAILED! => {"changed": false, "msg": "Unable to install package: E:Could not open file elasticsearch-curator - open (2: No such file or directory)"}�[0m

@przemyslavic
Copy link
Collaborator

/azp run

@azure-pipelines
Copy link

Azure Pipelines successfully started running 1 pipeline(s).

@przemyslavic
Copy link
Collaborator

/azp run

@azure-pipelines
Copy link

Azure Pipelines successfully started running 1 pipeline(s).

@przemyslavic
Copy link
Collaborator

/azp run

@azure-pipelines
Copy link

Azure Pipelines successfully started running 1 pipeline(s).

@przemyslavic
Copy link
Collaborator

/azp run

@azure-pipelines
Copy link

Azure Pipelines successfully started running 1 pipeline(s).

przemyslavic
przemyslavic previously approved these changes Mar 22, 2022
View reviewed changes
seriva
seriva previously approved these changes Mar 22, 2022
View reviewed changes
@sbbroot sbbroot dismissed stale reviews from seriva and przemyslavic via f5dfb5b March 22, 2022 12:17
@przemyslavic
Copy link
Collaborator

/azp run

@azure-pipelines
Copy link

Azure Pipelines successfully started running 1 pipeline(s).

przemyslavic
przemyslavic previously approved these changes Mar 22, 2022
View reviewed changes
@sbbroot sbbroot merged commit e773cfb into hitachienergy:develop Mar 22, 2022
@sbbroot sbbroot deleted the download-requirements-files-to-packages branch May 5, 2022 10:24
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@to-bar to-bar to-bar approved these changes

@przemyslavic przemyslavic przemyslavic approved these changes

@rafzei rafzei rafzei left review comments

@seriva seriva seriva left review comments

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
5 participants
@sbbroot @przemyslavic @seriva @rafzei @to-bar