SSU-DL

Deep learning implementation from scratch using Rust.

Implemented operations

• Identity
• Matrix Multiplication
• ReLU
• Element-wise addition
• Element-wise multiplication
• Softmax
• Softmax with cross entropy
• Transpose
• Layer Normalization
• Concat
• Sigmoid(Sum(x))
• Attention
• Encoder

Getting Started

1. Install rust and cargo.
2. Clone this repository to your local machine.
3. run cargo run --bin mnist or cargo run --bin essay_mock or cargo run --bin essay

MNIST Output

##### Test #####
Cross Entropy Error: 2.0229712
##### Learn #####
----- epoch 0 -----
Cross Entropy Error (validation): 0.84213644
----- epoch 1 -----
Cross Entropy Error (validation): 0.29854906
----- epoch 2 -----
Cross Entropy Error (validation): 0.028893478
----- epoch 3 -----
Cross Entropy Error (validation): 0.06684602
----- epoch 4 -----
Cross Entropy Error (validation): 0.01479665
##### Test #####
Cross Entropy Error (test): 0.0011330106

Project Description

https://github.com/wolfrev0/SSU-DL/blob/main/ProjectDescription.pdf

Report

https://github.com/wolfrev0/SSU-DL/blob/main/report.pdf