Skip to content

Commit

Permalink
Add Cloud SQL MySQL connectivity samples for SQLAlchemy. (#1828)
Browse files Browse the repository at this point in the history
* Add connectivity sample for SQLAlchemy.
* Address feedback.
  • Loading branch information
kurtisvg authored Nov 13, 2018
1 parent d295f9f commit 266b254
Show file tree
Hide file tree
Showing 5 changed files with 370 additions and 0 deletions.
70 changes: 70 additions & 0 deletions cloud-sql/mysql/sqlalchemy/README.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,70 @@
# Connecting to Cloud SQL - MySQL

## Before you begin

1. If you haven't already, set up a Python Development Environment by following the [python setup guide](https://cloud.google.com/python/setup) and
[create a project](https://cloud.google.com/resource-manager/docs/creating-managing-projects#creating_a_project).

1. Create a 2nd Gen Cloud SQL Instance by following these
[instructions](https://cloud.google.com/sql/docs/mysql/create-instance). Note the connection string,
database user, and database password that you create.

1. Create a database for your application by following these
[instructions](https://cloud.google.com/sql/docs/mysql/create-manage-databases). Note the database
name.

1. Create a service account with the 'Cloud SQL Client' permissions by following these
[instructions](https://cloud.google.com/sql/docs/mysql/connect-external-app#4_if_required_by_your_authentication_method_create_a_service_account).
Download a JSON key to use to authenticate your connection.

1. Use the information noted in the previous steps:
```bash
export GOOGLE_APPLICATION_CREDENTIALS=/path/to/service/account/key.json
export CLOUD_SQL_CONNECTION_NAME='<MY-PROJECT>:<INSTANCE-REGION>:<MY-DATABASE>'
export DB_USER='my-db-user'
export DB_PASS='my-db-pass'
export DB_NAME='my_db'
```
Note: Saving credentials in environment variables is convenient, but not secure - consider a more
secure solution such as [Cloud KMS](https://cloud.google.com/kms/) to help keep secrets safe.

## Running locally

To run this application locally, download and install the `cloud_sql_proxy` by
following the instructions [here](https://cloud.google.com/sql/docs/mysql/sql-proxy#install).

Once the proxy is ready, use the following command to start the proxy in the
background:
```bash
./cloud_sql_proxy -dir=/cloudsql --instances=$CLOUD_SQL_CONNECTION_NAME --credential_file=$GOOGLE_APPLICATION_CREDENTIALS
```
Note: Make sure to run the command under a user with write access in the
`/cloudsql` directory. This proxy will use this folder to create a unix socket
the application will use to connect to Cloud SQL.

Next, setup install the requirements into a virtual enviroment:
```bash
virtualenv --python python3 env
source env/bin/activate
pip install -r requirements.txt
```

Finally, start the application:
```bash
python main.py
```

Navigate towards `http://127.0.0.1:8080` to verify your application is running correctly.

## Google App Engine Standard

To run on GAE-Standard, create an App Engine project by following the setup for these
[instructions](https://cloud.google.com/appengine/docs/standard/python3/quickstart#before-you-begin).

First, update `app.yaml` with the correct values to pass the environment
variables into the runtime.

Next, the following command will deploy the application to your Google Cloud project:
```bash
gcloud app deploy
```
23 changes: 23 additions & 0 deletions cloud-sql/mysql/sqlalchemy/app.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,23 @@
# Copyright 2018 Google LLC
#
# Licensed under the Apache License, Version 2.0 (the "License");
# you may not use this file except in compliance with the License.
# You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.

runtime: python37

# Remember - storing secrets in plaintext is potentially unsafe. Consider using
# something like https://cloud.google.com/kms/ to help keep secrets secret.
env_variables:
CLOUD_SQL_INSTANCE_NAME: <MY-PROJECT>:<INSTANCE-REGION>:<MY-DATABASE>
DB_USER: my-db-user
DB_PASS: my-db-pass
DB_NAME: my_db
174 changes: 174 additions & 0 deletions cloud-sql/mysql/sqlalchemy/main.py
Original file line number Diff line number Diff line change
@@ -0,0 +1,174 @@
# Copyright 2018 Google LLC
#
# Licensed under the Apache License, Version 2.0 (the "License");
# you may not use this file except in compliance with the License.
# You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.

import datetime
import logging
import os

from flask import Flask, render_template, request, Response
import sqlalchemy


# Remember - storing secrets in plaintext is potentially unsafe. Consider using
# something like https://cloud.google.com/kms/ to help keep secrets secret.
db_user = os.environ.get("DB_USER")
db_pass = os.environ.get("DB_PASS")
db_name = os.environ.get("DB_NAME")
cloud_sql_instance_name = os.environ.get("CLOUD_SQL_INSTANCE_NAME")

app = Flask(__name__)

logger = logging.getLogger()

# [START cloud_sql_mysql_connection_pool]
# The SQLAlchemy engine will help manage interactions, including automatically
# managing a pool of connections to your database
db = sqlalchemy.create_engine(
# Equivalent URL:
# mysql+pymysql://<db_user>:<db_pass>@/<db_name>?unix_socket=/cloudsql/<cloud_sql_instance_name>
sqlalchemy.engine.url.URL(
drivername='mysql+pymysql',
username=db_user,
password=db_pass,
database=db_name,
query={
'unix_socket': '/cloudsql/{}'.format(cloud_sql_instance_name)
}
),
# ... Specify additional properties here.
# [START_EXCLUDE]

# [START cloud_sql_mysql_limit_connections]
# Pool size is the maximum number of permanent connections to keep.
pool_size=5,
# Temporarily exceeds the set pool_size if no connections are available.
max_overflow=2,
# The total number of concurrent connections for your application will be
# a total of pool_size and max_overflow.
# [END cloud_sql_mysql_limit_connections]

# [START cloud_sql_mysql_connection_backoff]
# SQLAlchemy automatically uses delays between failed connection attempts,
# but provides no arguments for configuration.
# [END cloud_sql_mysql_connection_backoff]

# [START cloud_sql_mysql_connection_timeout]
# 'pool_timeout' is the maximum number of seconds to wait when retrieving a
# new connection from the pool. After the specified amount of time, an
# exception will be thrown.
pool_timeout=30, # 30 seconds
# [END cloud_sql_mysql_connection_timeout]

# [START cloud_sql_mysql_connection_lifetime]
# 'pool_recycle' is the maximum number of seconds a connection can persist.
# Connections that live longer than the specified amount of time will be
# reestablished
pool_recycle=1800, # 30 minutes
# [END cloud_sql_mysql_connection_lifetime]

# [END_EXCLUDE]
)
# [END cloud_sql_mysql_connection_pool]


@app.before_first_request
def create_tables():
# Create tables (if they don't already exist)
with db.connect() as conn:
conn.execute(
"CREATE TABLE IF NOT EXISTS votes "
"( vote_id SERIAL NOT NULL, time_cast timestamp NOT NULL, "
"candidate CHAR(6) NOT NULL, PRIMARY KEY (vote_id) );"
)


@app.route('/', methods=['GET'])
def index():
votes = []
with db.connect() as conn:
# Execute the query and fetch all results
recent_votes = conn.execute(
"SELECT candidate, time_cast FROM votes "
"ORDER BY time_cast DESC LIMIT 5"
).fetchall()
# Convert the results into a list of dicts representing votes
for row in recent_votes:
votes.append({
'candidate': row[0],
'time_cast': row[1]
})

stmt = sqlalchemy.text(
"SELECT COUNT(vote_id) FROM votes WHERE candidate=:candidate")
# Count number of votes for tabs
tab_result = conn.execute(stmt, candidate="TABS").fetchone()
tab_count = tab_result[0]
# Count number of votes for spaces
space_result = conn.execute(stmt, candidate="SPACES").fetchone()
space_count = space_result[0]

return render_template(
'index.html',
recent_votes=votes,
tab_count=tab_count,
space_count=space_count
)


@app.route('/', methods=['POST'])
def save_vote():
# Get the team and time the vote was cast.
team = request.form['team']
time_cast = datetime.datetime.utcnow()
# Verify that the team is one of the allowed options
if team != "TABS" and team != "SPACES":
logger.warning(team)
return Response(
response="Invalid team specified.",
status=400
)

# [START cloud_sql_mysql_example_statement]
# Preparing a statement before hand can help protect against injections.
stmt = sqlalchemy.text(
"INSERT INTO votes (time_cast, candidate)"
" VALUES (:time_cast, :candidate)"
)
try:
# Using a with statement ensures that the connection is always released
# back into the pool at the end of statement (even if an error occurs)
with db.connect() as conn:
conn.execute(stmt, time_cast=time_cast, candidate=team)
except Exception as e:
# If something goes wrong, handle the error in this section. This might
# involve retrying or adjusting parameters depending on the situation.
# [START_EXCLUDE]
logger.exception(e)
return Response(
status=500,
response="Unable to successfully cast vote! Please check the "
"application logs for more details."
)
# [END_EXCLUDE]
# [END cloud_sql_mysql_example_statement]

return Response(
status=200,
response="Vote successfully cast for '{}' at time {}!".format(
team, time_cast)
)


if __name__ == '__main__':
app.run(host='127.0.0.1', port=8080, debug=True)
3 changes: 3 additions & 0 deletions cloud-sql/mysql/sqlalchemy/requirements.txt
Original file line number Diff line number Diff line change
@@ -0,0 +1,3 @@
Flask==1.0.2
SQLAlchemy==1.2.13
PyMySQL==0.9.2
100 changes: 100 additions & 0 deletions cloud-sql/mysql/sqlalchemy/templates/index.html
Original file line number Diff line number Diff line change
@@ -0,0 +1,100 @@
<!--
Copyright 2018 Google LLC
Licensed under the Apache License, Version 2.0 (the "License");
you may not use this file except in compliance with the License.
You may obtain a copy of the License at
http://www.apache.org/licenses/LICENSE-2.0
Unless required by applicable law or agreed to in writing, software
distributed under the License is distributed on an "AS IS" BASIS,
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
See the License for the specific language governing permissions and
limitations under the License.
-->
<html lang="en">
<head>
<title>Tabs VS Spaces</title>
<link rel="stylesheet"
href="https://cdnjs.cloudflare.com/ajax/libs/materialize/1.0.0/css/materialize.min.css">
<link href="https://fonts.googleapis.com/icon?family=Material+Icons" rel="stylesheet">
<script src="https://cdnjs.cloudflare.com/ajax/libs/materialize/1.0.0/js/materialize.min.js"></script>
</head>
<body>
<nav class="red lighten-1">
<div class="nav-wrapper">
<a href="#" class="brand-logo center">Tabs VS Spaces</a>
</div>
</nav>
<div class="section">
<div class="center">
<h4>
{% if tab_count == space_count %}
TABS and SPACES are evenly matched!
{% elif tab_count > space_count %}
TABS are winning by {{tab_count - space_count}}
{{'votes' if tab_count - space_count > 1 else 'vote'}}!
{% elif space_count > tab_count %}
SPACES are winning by {{space_count - tab_count}}
{{'votes' if space_count - tab_count > 1 else 'vote'}}!
{% endif %}
</h4>
</div>
<div class="row center">
<div class="col s6 m5 offset-m1">
<div class="card-panel {{'green lighten-3' if tab_count > space_count}}">
<i class="material-icons large">keyboard_tab</i>
<h3>{{tab_count}} votes</h3>
<button id="voteTabs" class="btn green">Vote for TABS</button>
</div>
</div>
<div class="col s6 m5">
<div class="card-panel {{'blue lighten-3' if tab_count < space_count}}">
<i class="material-icons large">space_bar</i>
<h3>{{space_count}} votes</h3>
<button id="voteSpaces" class="btn blue">Vote for SPACES</button>
</div>
</div>
</div>
<h4 class="header center">Recent Votes</h4>
<ul class="container collection center">
{% for vote in recent_votes %}
<li class="collection-item avatar">
{% if vote.candidate == "TABS" %}
<i class="material-icons circle green">keyboard_tab</i>
{% elif vote.candidate == "SPACES" %}
<i class="material-icons circle blue">space_bar</i>
{% endif %}
<span class="title">
A vote for <b>{{vote.candidate}}</b>
</span>
<p>was cast at {{vote.time_cast}}</p>
</li>
{% endfor %}
</ul>
</div>
<script>
function vote(team) {
var xhr = new XMLHttpRequest();
xhr.onreadystatechange = function () {
if (this.readyState == 4) {
if (!window.alert(this.responseText)) {
window.location.reload();
}
}
};
xhr.open("POST", "/", true);
xhr.setRequestHeader("Content-Type", "application/x-www-form-urlencoded");
xhr.send("team=" + team);
}

document.getElementById("voteTabs").addEventListener("click", function () {
vote("TABS");
});
document.getElementById("voteSpaces").addEventListener("click", function () {
vote("SPACES");
});
</script>
</body>
</html>

0 comments on commit 266b254

Please sign in to comment.