Skip to content
This repository has been archived by the owner on Apr 10, 2024. It is now read-only.

Stable URLs, s3 link improvements #79

Merged
merged 112 commits into from
Jun 3, 2021
Merged

Stable URLs, s3 link improvements #79

merged 112 commits into from
Jun 3, 2021

Conversation

echyam
Copy link
Contributor

@echyam echyam commented Nov 13, 2020 •
edited by mayadebellis
Loading

NOTE: these changes will brake current functionalities in pilot ops environment

Lots of updates for GCC Migration

  • Make all extensions compatible with Che 7 and new setup on GCC
  • Remove any s3fs mounting code (this is now handled in a separate container)
  • Modify ssh capabilities to work in new environment
  • Update entrypoint script to work with new kubernetes set up

Changes pre GCC Migration
from @bsatoriu:

  • use a config for MAAP URLs
  • replace stateDB with server lookup
  • set OPS as default environment

from @mayadebellis:

  • update ops edsc port (edsc)

from @echyam:

  • parse new API XML format (submit_jobs)
  • s3 link improvements (show_ssh_info):
    • error messaging for invalid s3 paths
    • link duration selection dropdown menu
    • copy (to clipboard) button when link generated
  • remove left panel with tabs list (insert_defaults_to_notebook)

bsatoriu and others added 30 commits September 1, 2020 16:05
@bsatoriu
add uat base urls and buckets
6b175b4
@bsatoriu
config-based urls: maapsec
576730d
@bsatoriu
dps_magic readme typo
eba71a7
@bsatoriu
config based urls: submit_jobs
9e7a70c
@bsatoriu
config based urls: dps_info
0ccb33b
@bsatoriu
config based urls: pull_projects
17650c7
@bsatoriu
revert timeout setting change
bc6ca56
@bsatoriu
config based urls: ssh_info
c919de0
@bsatoriu
add default_host field for explicitness
d646937
@bsatoriu
remove hard coded url from dps_info client
a561ee3
@bsatoriu
clean up hard coded url references
88ea828
@bsatoriu
remove unnecessary state param
f89c0fc
@bsatoriu
Merge pull request #69 from MAAP-Project/maap-uat-environment
ac59521 
add uat base urls and buckets
@bsatoriu
Update dps_magic to use maap_environments.json
f61ebbd
@bsatoriu
send presigned s3 url req to maap api
363756a
@bsatoriu
fix ci build error
2ec6707
@bsatoriu
Update entrypoint.sh
2d4cfc2
@bsatoriu
Replace statedb environment with server lookup
dac03ca
@bsatoriu
replace env statedb with server lookup
732dfe7
@bsatoriu
set ade_server in client once during startup
4959737
@bsatoriu
Merge pull request #71 from MAAP-Project/maap-env-improvements-dev
66c39fe 
Maap env improvements dev
@bsatoriu
fix keycloak callback error
646ba92
@bsatoriu
Merge pull request #72 from MAAP-Project/maap-env-improvements-dev
a9c0a6e 
fix keycloak callback error
@echyam
submit jobs convert to tabs to spaces
7f346a7
@echyam
fix submit jobs getMetrics result key
e501551
@echyam
fix dps_info ref to state
bc1d4f7
@echyam
Use maap-py for MAAP API (#73)
1859425 
* use maap-py for list jobs
* use maap-py for desribe process
* use maap-py for get job result
* use maap-py for get job metrics
* use maap-py for get job status
* use maap-py for get execute inputs
* use maap-py for delete job
* use maap-py for dismiss job
* use maap-py for get capabilities
* use maap-py for publish algorithm
* use maap-py for delete algorithm
* use maap-py for execute job
* fix mismatching keys in submit_jobs to maap-py
* use maap-py for register algorithm
@bsatoriu
move edsc url to configuration file
dd3464b
@bsatoriu
Merge branch 'develop' of https://github.com/MAAP-Project/maap-jupyte…
1c59a75 
…r-ide into develop
@echyam
Registration updates (#74)
2b3c631 
* fix mismatching keys in submit_jobs to maap-py
* use maap-py for register algorithm
* pass username to defaultvalues helper
* prepend "demo-${username}-" to tutorial hello world algorithm name
* use regex to match hello-world repo under any group or user
* add dynamic queue selection for algo registration
* properly re-populate algo config with memory selection and add instructions for disk size
mayadebellis and others added 28 commits February 19, 2021 16:30
@mayadebellis
remove references to che installers (#84)
24b05c1
@bsatoriu
replace org mount with shared workspace mount
addc7d3
@mayadebellis
start ssh in entrypoint, add username namespace
db76eae
@bsatoriu
Revert shared ws mount and remove read-only
9537a27
@mayadebellis
fix merge conflict
786bede
@mayadebellis
Merge pull request #85 from MAAP-Project/update-ssh-info
b9822fb 
Start ssh service, fix namespace
@bsatoriu
Replace memory with queue
c744647
@mayadebellis
switch from ip address of worker to host address of ade
5f75847
@mayadebellis
update pull projects for che7
105ff7e
@bsatoriu
Dev update
482242b
@bsatoriu
Readme
7eb0448
@gchang
Updated entrypoint.sh to make the fix to run Jupyter under Che in 'si…
c1fe2c3 
…ngle-host' mode more generic. Should accommodate Jupyter 2.x & 3.x now.
@gchang
Update entrypoint.sh
8d4a7cf 
Added echo in empty else.
@mayadebellis
fix key error in pull projects when no proj exists
fa8d269
@bsatoriu
Update maap_environments.json
272a32a
@gchang
Added the inline python code to generate the url prefix (#86)
79f77a6 
* Updated preview url generation to be more robust so that it'll work with multiple workspaces and won't need the MACHINE_NAME variable in the devfile.

* Also fix directories for publickey authentication.
@gchang
Fixed entrypoint.sh to work in the current UAT environment too
c7b5bdb
@mayadebellis
remove s3fs and mounting refernces (#87)
9664628
@bsatoriu
Reattempt PREVIEW_URL fetch on failure
8b1ef82
@mayadebellis
update ssh service to find nodeport (#88)
5fea174
@mayadebellis
remove sucess message that actually fails
f3cb328
@mayadebellis
Merge branch 'develop' of https://github.com/MAAP-Project/maap-jupyte…
765251e 
…r-ide into develop
@bsatoriu
Add workspace argument to presigned s3 url paths
3628dc2
@bsatoriu
Fix environment pre-ops 'workspace_bucket' name
c1418a4
@bsatoriu
Remove timestamp from algo reg
90a8c23
@bsatoriu
Merge branch 'develop' of https://github.com/MAAP-Project/maap-jupyte…
fcb91db 
…r-ide into develop

Merge
@mayadebellis
update readme
e253de5
@mayadebellis
Merge branch 'master' into develop
543de23
@mayadebellis mayadebellis merged commit 8b5bc7f into master Jun 3, 2021
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Reviewers

@mayadebellis mayadebellis mayadebellis approved these changes

@bsatoriu bsatoriu Awaiting requested review from bsatoriu

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
4 participants
@echyam @mayadebellis @bsatoriu @gchang