Deep Learning Study with Gluon2 (2018.03 ~ )

https://github.com/ski-net/dl_study_with_gluon_2nd

---

Deep Learning Study with Gluon (2017.12 ~ 2018.03)

Deep learning to learn while making

Schedule

Topic	Date/Time	Location	Presentor
Gluon Introduction	12/22,17:00	분석실	haven-jeon ,seujung
Convolution & Transfer Learning	12/28,17:00	분석실	haven-jeon
Intro with MNIST(Logistic, FC, CNN),Embedding, Intro Audio Data Analysis	01/04,18:00	분석실	soohwanjo, soeque1, hongdm7
Style Transfer(0h20m), Fashion MNIST(0h10m), Traffic Sign Recognition(0h15m), Intro MXNet(0h10m)	01/11,18:00	분석실	seujung, haven-jeon, June-H, hyemin15
Intro to GAN(0h15m), Intro to VAE(0h30m)	01/16,18:00	분석실	soeque1, kionkim
Multi GPU(0h20m), Autoencoder(0h30m), Transfer Learning (0h40m)	01/25,18:00	분석실	haven-jeon, ljy3795, su-park
RNNs with Audio Classification(0h30m), CAM with Traffic Sign Classification(0h 20m)	02/01,18:00	분석실	hongdm7, June-H
Pix2Pix(0h25m), Deep Matrix Factorization (0h20m)	02/08,18:00	분석실	soeque1, ljy3795, kionkim
introduction Deep Learning references	03/14,12:00	분석실	seujung
Soft Decision Tree (0h30m), Deep Dream (0h20m)	02/22,18:00	분석실	kionkim, soohwanjo
Korean-English Neural Machine Translater(0h40m)	02/28,18:00	분석실	haven-jeon
IntegratedGradients (0h20m), BEGAN (0h20m),QA- Multimodal Compact Bilinear Pooling (0h45m)	03/08,18:00	분석실	kionkim, seujung , hyemin15, soeque1
1차 롤 아웃/2차 스터디 계획 수립	03/13,12:00	분석실
Deep Q-Network(0h30m), Double Deep Q-Network, Policy Gradient	03/15,18:00	분석실	hongdm7, soohwanjo, June-H
Anomaly detection w Autoencoder, CapsNet(0h30m)	03/22,18:00	분석실	ljy3795, kionkim
relational network,	03/29,18:00	분석실	seujung

• Attendance

Topic

Linear algebra

• https://github.com/fastai/numerical-linear-algebra (@seujung)

numpy exercise

• https://github.com/Kyubyong/numpy_exercises (@seujung)

Gluon Basic

• Gluon Introduction, 12/22
• Intro mxnet NDArray, Symbol, Model (@hyemin15)
• intro Grad
• intro with MNIST (@soohwanjo)

Fully Connected

• Classification model with MNIST (@seujung)

Convolution

• Image classification with Convolution (@haven-jeon, cats and dogs )

• Fashion MNIST

• Transfer Leraning (@haven-jeon, cats and dogs classification)

• CAM and Grad CAM (@haven-jeon, cats and dogs classification)

• Image classification with MNIST (@soohwanjo)

• Image classification with 62 classes Traffic Sign (@June-H)

• Medical Image Segmentation (@supark)

• Super resolution (@soohwanjo)

• AlexNet

  • https://papers.nips.cc/paper/4824-imagenet-classification-with-deep-convolutional-neural-networks.pdf

• ResNet

  • https://arxiv.org/pdf/1512.03385.pdf

• Inception V4

  • https://arxiv.org/pdf/1602.07261.pdf

• DenseNet

  • https://arxiv.org/pdf/1608.06993.pdf

• CapsNet

  • https://arxiv.org/pdf/1710.09829.pdf

Recurrent

• Introduction of Audio Data (@hongdm7, Whale Sound Data)
• RNNs with Audio Classification (@hongdm7, Whale Sound Data)
• Stock Price Prediction with Amazon Stock Data (@hyemin15)

Image

Deep Dream

• Deep Dream (@soohwanjo)

Neural Style Transfer

• neural style transfer (@seujung)
  • https://www.cv-foundation.org/openaccess/content_cvpr_2016/papers/Gatys_Image_Style_Transfer_CVPR_2016_paper.pdf
• fast neural style transfer (@seujung)

pix2pix

• pix2pix (@hjkim)

NLP

• Sentiment Classification (@supark, 네이버 영화 평점)
• seq2seq (@haven-jeon, Addition model)
• seq2seq with Attention Mechanism (@haven-jeon, Addition model)
• Text Generation(@EVA01)
• Text summarization (@haven-jeon,)
• Korean-English Neural Machine Translater (@haven-jeon)

high-performance learning

Autoencoder

• simple & conv. Autoencoder (@ljy3795)
• Anomaly detection with Autoencoder (@ljy3795)

Audio

• wavenet

Recommandation

• Deep Matrix Factorization (@ljy3795)
• Deep Matrix Factorization -- Fix InnerProduct Calculations (@supark)

XAI

• The Bayesian Case Model: A Generative Approach for Case-Based Reasoning and Prototype Classification (@kionkim)
  • https://arxiv.org/pdf/1503.01161.pdf
• Distilling a Neural Network Into a Soft Decision Tree (@kionkim)
  • https://arxiv.org/pdf/1711.09784.pdf

GAN(Generative Adversarial Networks)

• GAN (@hjkim)
  • https://arxiv.org/pdf/1406.2661.pdf
• DCGAN (@seujung)
  • https://arxiv.org/pdf/1511.06434.pdf
• DiscoGAN
  • https://arxiv.org/pdf/1703.05192.pdf
• WGAN
  • https://arxiv.org/pdf/1701.07875.pdf
• BEGAN (@seujung)
  • https://arxiv.org/pdf/1703.10717.pdf
• BiGAN (@hjkim)
  • https://arxiv.org/pdf/1605.09782.pdf

VAE(Variational Auto Encoder)

• Introduction to VAE
• Tutorial on Variational Autoencoders (@kionkim)
  • https://arxiv.org/pdf/1606.05908.pdf

Embedding

• Word2Vec (@hjkim, text8)
  • http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.764.2227&rep=rep1&type=pdf

Computer Age Statistical Inference(CASI)

• https://web.stanford.edu/~hastie/CASI

QA

• relational network (@seujung)
  • https://arxiv.org/pdf/1706.01427.pdf
• Visual Question Answering (@kionkim, @hyemin15)

Reinforcement Learning

• DQN(Deep Q-Network) (@hongdm7)
• DDQN(Double Deep Q-Network) (@soohwanjo)

Reference

• https://github.com/zackchase/gluon-slides/blob/master/sept18-gluon.pdf
• https://github.com/zackchase/mxnet-the-straight-dope
• https://github.com/SherlockLiao/mxnet-gluon-tutorial
• https://github.com/gluon-api/gluon-api
• http://blog.creation.net/mxnet-part-1-ndarrays-api#.WjyR21SFiu7