Skip to content

Commit

Permalink
add debug statements
Browse files Browse the repository at this point in the history
  • Loading branch information
Jeremy Nicklas committed Apr 23, 2018
1 parent 9f0f5dd commit 3609f0f
Show file tree
Hide file tree
Showing 2 changed files with 14 additions and 0 deletions.
3 changes: 3 additions & 0 deletions CHANGELOG.md
Original file line number Diff line number Diff line change
Expand Up @@ -5,6 +5,9 @@ The format is based on [Keep a Changelog](http://keepachangelog.com/en/1.0.0/)
and this project adheres to [Semantic Versioning](http://semver.org/spec/v2.0.0.html).

## [Unreleased]
### Added
- Added timestamps in output to make debugging easier.

### Changed
- Increased timeout from 60 to 120 seconds.

Expand Down
11 changes: 11 additions & 0 deletions template/script.sh.erb
Original file line number Diff line number Diff line change
Expand Up @@ -23,6 +23,9 @@
# Start Jupyter Notebook server + Spark cluster
#

echo "Starting main script..."
echo "TTT - $(date)"

# Clean the environment
module purge

Expand Down Expand Up @@ -88,6 +91,8 @@ else
fi
sleep 2

echo "TTT - $(date)"

# Create Spark worker launcher script
export SPARK_WORKER_SCRIPT="${PWD}/spark-worker.sh"
(
Expand Down Expand Up @@ -196,16 +201,22 @@ EOL
# Set working directory to notebook root directory
cd "${NOTEBOOK_ROOT}"

echo "TTT - $(date)"

# Setup Jupyter Notebook environment
module use $MODULEPATH_ROOT/project/ondemand
module load jupyter/python3.5
module list

echo "TTT - $(date)"

# List available kernels for debugging purposes
set -x
jupyter kernelspec list
{ set +x; } 2>/dev/null

echo "TTT - $(date)"

# Launch Jupyter Notebook interface to Spark
set -x
jupyter notebook --config="${CONFIG_FILE}"

0 comments on commit 3609f0f

Please sign in to comment.