Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Improve performance of gateway by improving performance of GatewayDaemonAPI SSL #418

Merged
merged 8 commits into from
Jun 16, 2022

Conversation

parasj
Copy link
Contributor

@parasj parasj commented Jun 15, 2022

Fixes SKY-188

werkzeug serves the GatewayDaemonAPI over http but wasn't able to perform https at sufficient speed. This uses stunnel as an SSL reverse proxy.

$ pip install -e . && source scripts/pack_docker.sh && skylark replicate-random aws:us-east-1 aws:ap-northeast-1 --reuse-gateways -s $((1024*32))
 _____ _   ____   _______ _       ___   _   _  _____ 
/  ___| | / /\ \ / / ___ \ |     / _ \ | \ | ||  ___|
\ `--.| |/ /  \ V /| |_/ / |    / /_\ \|  \| || |__  
 `--. \    \   \ / |  __/| |    |  _  || . ` ||  __| 
/\__/ / |\  \  | | | |   | |____| | | || |\  || |___ 
\____/\_| \_/  \_/ \_|   \_____/\_| |_/\_| \_/\____/


Will transfer 4096 objects totaling 32.00GB
    VMs to provision: 1x aws:ap-northeast-1, 1x aws:us-east-1

Using overridden docker image: ghcr.io/skyplane-project/skyplane:local-5d51742800ab1321c7d3ab137508d2d2
Instances will remain up and may result in continued cloud billing. Remember to call `skyplane deprovision` to deprovision gateways.
Storing debug information for transfer in /tmp/skyplane/transfer_logs/20220615_034656/client.log
✓ Initializing cloud keys (5/5) in 4.54s
✓ Provisioning gateway instances (2/2) in 40.72s
✓ Installing gateway package (2/2) in 18.74s
🚀 32.00GB transfer job launched
  Transfer progress (4096 of 4096 chunks) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 32.0/32.0 GiB 478.9 MB/s 0:00:00

✅ Transfer completed successfully
Transfer runtime: 70.11s, Throughput: 3.65Gbps

@linear
Copy link

linear bot commented Jun 15, 2022

@parasj parasj changed the title [draft] Improve performance of gateway by improving performance of GatewayDaemonAPI SSL Improve performance of gateway by improving performance of GatewayDaemonAPI SSL Jun 15, 2022
@samkumar
Copy link
Contributor

This works fine for me. I'll go ahead and merge it now.

@samkumar samkumar merged commit 84623f4 into main Jun 16, 2022
@samkumar samkumar deleted the paras/sky-188-417-perf-using-the-https-api-for branch June 16, 2022 00:37
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants