Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Wait for #2568][Mixed] Mixed Precision Layer update #2579

Closed
wants to merge 47 commits into from
Closed

[Wait for #2568][Mixed] Mixed Precision Layer update #2579

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
47 commits
Select commit Hold shift + click to select a range
a92784b
[ Weight ] Add Var32 Tensor in Weight.
jijoongmoon May 2, 2024
b6ad1d0
[ Mixed ] Create weight with var32 tensor
jijoongmoon May 7, 2024
8b7b44f
[ Layers ] Update Layers to support FP16
jijoongmoon May 7, 2024
27ebec6
[ Test ] Mixed Precision Test Case
jijoongmoon May 7, 2024
0593c27
[ Optimizer ] Update Optimizer / Adam to support Mixed training
jijoongmoon May 9, 2024
59b7c2e
[ Tensor ] add is_NaN check in Tensor
jijoongmoon May 8, 2024
adc2f2a
[ Context ] Add loss scale in Context & using mse loss
jijoongmoon May 11, 2024
929eab9
[ Mixed Precision ] Enable Mixed Precision
jijoongmoon May 13, 2024
478e4c6
[ Tensor ] Add inifinity check in Tensor
jijoongmoon May 14, 2024
c2b28dd
[ MSE ] Fix for better MSE loss precision
jijoongmoon May 17, 2024
7bd4989
[ TEST ] Add Torch Mixed Precision Model Test
jijoongmoon May 17, 2024
6c29394
[ TEST ] add torch input and output test data for mixed precision
jijoongmoon May 20, 2024
f95f152
[ TEST ] Add more unittest and fixes for mixed precsion
jijoongmoon May 24, 2024
6b357e6
[Application] fix LLaMA application example error
baek2sm May 7, 2024
e8ac7ad
[CI] Remove Pylinter in CI
DonghakPark May 9, 2024
b84cb33
[Trivial] Removing unnecessary files from the repo and adding an igno…
DonghakPark May 8, 2024
4c9ad35
[ hdot ] Use precision-enhanced hdot
skykongkong8 Apr 24, 2024
1027d4a
[hgemm] Interchanged hgemm_noTrans_1x8 and hgemm_noTrans_4x4 calls
s-debadri May 8, 2024
01f3d4d
[hgemm] Added K divisible condition for 1x8 and 1x4 kernels
s-debadri May 8, 2024
9a0338c
[hgemm] Optimizing dimension checks using bitmask
s-debadri May 9, 2024
72b17c3
[Application] Rename yolo -> yolo v2
baek2sm May 8, 2024
e218505
[Application] cuda support for example of pytorch yolo v2
baek2sm May 8, 2024
23ac075
[Nnstreamer-subplugin] Add save_path to setProperty
songgot May 17, 2024
2be8b87
[Application] update yolo v2 python for building pre-training model
baek2sm May 17, 2024
1c99028
[bugfix] Fix LoRA indices array size in the FC layer
djeong20 May 20, 2024
316b090
[coverity] fix coverity issue
djeong20 May 21, 2024
73508f2
[Trivial] Update gitignore file
baek2sm May 22, 2024
2e7d656
Edited build instructions for Resnet18 test
udit01 May 22, 2024
1e1112d
[ hgemm ] Implement 4x4 f16-f32 kernel
skykongkong8 Apr 12, 2024
8a2887f
[ hgemm ] Add 4x4 kernel-using f16-f32 hgemm_noTrans
skykongkong8 Apr 12, 2024
6137cea
[ hgemm ] Apply macro kernel in 4x4 noTrans
skykongkong8 Apr 12, 2024
46ecb26
[ hgemm ] Apply ACC16 partial sum strategy & adaptive macro use in 8x…
skykongkong8 Apr 15, 2024
5d0eba8
[ hgemm ] Apply acc16 partial sum strategy and adaptive macro use in …
skykongkong8 Apr 15, 2024
a11dab7
[ hgemm/bugfix ] Adaptive macro kernel usage in 4x4 4x8 kernels
skykongkong8 Apr 15, 2024
b26edf0
[ hgemm ] Refactor kernel init process
skykongkong8 Apr 15, 2024
a012f73
[ Trivial ] Remove redundant comments and format
skykongkong8 Apr 15, 2024
933f47a
[GPU/OpenCL] Initial version of FC Layer with OpenCL ops
s-debadri May 7, 2024
a08d9f0
[unittest] Added test for incremental forwarding for layers
s-debadri May 9, 2024
eff5f0a
[GPU/OpenCL] Resuable blas OpenCL kernels
s-debadri May 14, 2024
ff3ceb7
[bugfix] Renamed variables in unittest of FC Layer
s-debadri May 15, 2024
48c61dc
[bugfix] Used global memmory for result in dot_cl kernel
s-debadri May 16, 2024
75b04b0
[bugfix/refactor] OpenCL buffer creation fix and optimization
s-debadri May 17, 2024
c277650
[Application] update yolo v2 modeling
baek2sm May 22, 2024
ff1f76b
[goldendata] Added script to generate Swiglu data
s-debadri May 23, 2024
27c9f0f
[Test] Add conv2d test for fp16
jihochu Mar 6, 2024
600f996
[Layers] Modify layers for data type
jihochu Mar 14, 2024
1d4b135
[Mixed] Mixed Precision Layer update
DonghakPark May 7, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
51 changes: 0 additions & 51 deletions .github/workflows/pylint.yml
View file
Open in desktop

This file was deleted.

1 change: 1 addition & 0 deletions .gitignore
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -5,6 +5,7 @@
/build
/builddir
.cache/
.idea/

# jni build files
iniparser/
Expand Down
19 changes: 19 additions & 0 deletions Applications/Android/PicoGPTJNI/.gitignore
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,19 @@
*.iml
.gradle
/.vscode
/.idea
/local.properties
/.idea/caches
/.idea/libraries
/.idea/modules.xml
/.idea/workspace.xml
/.idea/navEditor.xml
/.idea/assetWizardSettings.xml
.DS_Store
/build
/captures
.externalNativeBuild
.cxx
local.properties
/app/src/main/jniLibs
/app/src/main/obj
Binary file removed Applications/Android/PicoGPTJNI/.gradle/7.5/checksums/checksums.lock
View file
Open in desktop
Binary file not shown.
Binary file removed ...cations/Android/PicoGPTJNI/.gradle/7.5/dependencies-accessors/dependencies-accessors.lock
View file
Open in desktop
Binary file not shown.
Empty file removed Applications/Android/PicoGPTJNI/.gradle/7.5/dependencies-accessors/gc.properties
View file
Open in desktop
Empty file.
Binary file removed Applications/Android/PicoGPTJNI/.gradle/7.5/executionHistory/executionHistory.lock
View file
Open in desktop
Binary file not shown.
Binary file removed Applications/Android/PicoGPTJNI/.gradle/7.5/fileHashes/fileHashes.lock
View file
Open in desktop
Binary file not shown.
Empty file removed Applications/Android/PicoGPTJNI/.gradle/7.5/gc.properties
View file
Open in desktop
Empty file.
Binary file removed Applications/Android/PicoGPTJNI/.gradle/buildOutputCleanup/buildOutputCleanup.lock
View file
Open in desktop
Binary file not shown.
2 changes: 0 additions & 2 deletions Applications/Android/PicoGPTJNI/.gradle/buildOutputCleanup/cache.properties
View file
Open in desktop

This file was deleted.

Binary file removed Applications/Android/PicoGPTJNI/.gradle/checksums/checksums.lock
View file
Open in desktop
Binary file not shown.
Binary file removed Applications/Android/PicoGPTJNI/.gradle/file-system.probe
View file
Open in desktop
Binary file not shown.
Empty file removed Applications/Android/PicoGPTJNI/.gradle/vcs-1/gc.properties
View file
Open in desktop
Empty file.
6 changes: 0 additions & 6 deletions Applications/Android/PicoGPTJNI/.idea/compiler.xml
View file
Open in desktop

This file was deleted.

20 changes: 0 additions & 20 deletions Applications/Android/PicoGPTJNI/.idea/gradle.xml
View file
Open in desktop

This file was deleted.

12 changes: 0 additions & 12 deletions Applications/Android/PicoGPTJNI/.idea/misc.xml
View file
Open in desktop

This file was deleted.

6 changes: 0 additions & 6 deletions Applications/Android/PicoGPTJNI/.idea/vcs.xml
View file
Open in desktop

This file was deleted.

147 changes: 0 additions & 147 deletions Applications/Android/PicoGPTJNI/.idea/workspace.xml
View file
Open in desktop

This file was deleted.

19 changes: 19 additions & 0 deletions Applications/Android/ResnetJNI/.gitignore
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,19 @@
*.iml
.gradle
/.vscode
/.idea
/local.properties
/.idea/caches
/.idea/libraries
/.idea/modules.xml
/.idea/workspace.xml
/.idea/navEditor.xml
/.idea/assetWizardSettings.xml
.DS_Store
/build
/captures
.externalNativeBuild
.cxx
local.properties
/app/src/main/jniLibs
/app/src/main/obj
Binary file removed Applications/Android/ResnetJNI/.gradle/7.5/checksums/checksums.lock
View file
Open in desktop
Binary file not shown.
Binary file removed ...ications/Android/ResnetJNI/.gradle/7.5/dependencies-accessors/dependencies-accessors.lock
View file
Open in desktop
Binary file not shown.
Empty file removed Applications/Android/ResnetJNI/.gradle/7.5/dependencies-accessors/gc.properties
View file
Open in desktop
Empty file.
Binary file removed Applications/Android/ResnetJNI/.gradle/7.5/executionHistory/executionHistory.lock
View file
Open in desktop
Binary file not shown.
Binary file removed Applications/Android/ResnetJNI/.gradle/7.5/fileHashes/fileHashes.lock
View file
Open in desktop
Binary file not shown.
Empty file removed Applications/Android/ResnetJNI/.gradle/7.5/gc.properties
View file
Open in desktop
Empty file.
Binary file removed Applications/Android/ResnetJNI/.gradle/buildOutputCleanup/buildOutputCleanup.lock
View file
Open in desktop
Binary file not shown.
2 changes: 0 additions & 2 deletions Applications/Android/ResnetJNI/.gradle/buildOutputCleanup/cache.properties
View file
Open in desktop

This file was deleted.

Binary file removed Applications/Android/ResnetJNI/.gradle/checksums/checksums.lock
View file
Open in desktop
Binary file not shown.
Binary file removed Applications/Android/ResnetJNI/.gradle/file-system.probe
View file
Open in desktop
Binary file not shown.
Empty file removed Applications/Android/ResnetJNI/.gradle/vcs-1/gc.properties
View file
Open in desktop
Empty file.
6 changes: 0 additions & 6 deletions Applications/Android/ResnetJNI/.idea/compiler.xml
View file
Open in desktop

This file was deleted.

20 changes: 0 additions & 20 deletions Applications/Android/ResnetJNI/.idea/gradle.xml
View file
Open in desktop

This file was deleted.

5 changes: 0 additions & 5 deletions Applications/Android/ResnetJNI/.idea/misc.xml
View file
Open in desktop

This file was deleted.

Loading