Skip to content

Using ARM Compute Library (NEON+GPU) to speed up caffe; Providing utilities to debug, profile and tune application performance

License

Notifications You must be signed in to change notification settings

RockchipOpensourceCommunity/CaffeOnACL

 
 

Repository files navigation

CaffeOnACL

License

Support Android platform.

CaffeOnACL is a project that is maintained by OPEN AI LAB, it uses Arm Compute Library (NEON+GPU) to speed up Caffe and provide utilities to debug, profile and tune application performance.

The release version is 0.4.0, is based on Rockchip RK3399 Platform, target OS is Ubuntu 16.04. Can download the source code from OAID/CaffeOnACL

  • The ARM Computer Vision and Machine Learning library is a set of functions optimised for both ARM CPUs and GPUs using SIMD technologies. See also Arm Compute Library.
  • Caffe is a fast open framework for deep learning. See also Caffe.

Documents

Arm Compute Library Compatibility Issues :

There are some compatibility issues between ACL and Caffe Layers, we bypass it to Caffe's original layer class as the workaround solution for the below issues

  • Normalization in-channel issue
  • Tanh issue
  • Softmax supporting multi-dimension issue
  • Group issue

Performance need be fine turned in the future

Release History

The Caffe based version is 793bd96351749cb8df16f1581baf3e7d8036ac37.

Version 0.4.0 - Oct 11, 2017

Support Arm Compute Library version 17.09

Version 0.3.0 - Aug 26, 2017

Support Arm Compute Library version 17.06 with 4 new layers added

  • Batch Normalization Layer
  • Direct convolution Layer
  • Locally Connect Layer
  • Concatenate layer

Version 0.2.0 - Jul 2, 2017

Fix the issues:

  • Compatible with Arm Compute Library version 17.06
  • When OpenCL initialization fails, even if Caffe uses CPU-mode,it doesn't work properly.

Version 0.1.0 - Jun 2, 2017

Initial version supports 10 Layers accelerated by Arm Compute Library version 17.05 :

  • Convolution Layer
  • Pooling Layer
  • LRN Layer
  • ReLU Layer
  • Sigmoid Layer
  • Softmax Layer
  • TanH Layer
  • AbsVal Layer
  • BNLL Layer
  • InnerProduct Layer

Issue Report

Encounter any issue, please report on issue report. Issue report should contain the following information :

  • The exact description of the steps that are needed to reproduce the issue
  • The exact description of what happens and what you think is wrong

About

Using ARM Compute Library (NEON+GPU) to speed up caffe; Providing utilities to debug, profile and tune application performance

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • C++ 81.8%
  • Python 7.9%
  • Cuda 5.3%
  • CMake 2.7%
  • MATLAB 0.9%
  • Makefile 0.7%
  • Other 0.7%