Skip to content

Latest commit

 

History

History
37 lines (24 loc) · 2.09 KB

AccelNNPAHowToUseAndTest.md

File metadata and controls

37 lines (24 loc) · 2.09 KB
Raw

Build and test for Accelerator NNPA

Neural Network Processing Assist Facility (NNPA) is implemented on processor units of IBM z16. Onnx-mlir can use it via IBM Z Deep Neural Network Library (zDNN). Building and lit tests runs on other IBM Z systems(eg. z15), but numerical tests need to run on z16.

Build

Add following CMake option to build onnx-mlir for NNPA. Regarding build command for Linux OS, see here

  • -DONNX_MLIR_ACCELERATORS=NNPA

Test

  • Lit tests

The lit tests for NNPA are included in test/mlir/accelerators/nnpa. When building onnx-mlir for NNPA, these lit tests also run with the following same command with CPU.

cmake --build . --target check-onnx-lit
  • Numerical tests

Numerical tests for NNPA are provided in test/accelerators/NNPA/numerical. Currently tests for MatMul2D, Gemm, LSTM, and GRU are provided and run by using following command.

cmake --build . --config Release --target check-onnx-numerical-nnpa

These tests uses the same test code with numerical tests for CPU (test/modellib and test/numerial), but uses different cmake file(test/accelerator/NNPA/numerical/CMakeLists.txt).

  • Gemm Since alpha and beta should be one for Matmul of zDNN library, #ifdef directive TEST_GEMM_ALPHA_BETA_1 are added in test/numerical/TestGemm.cpp and set in the CMakeLists.txt (test/accelerator/NNPA/numerical/CMakeLists.txt)
  • LSTM Since LSTM of zDNN library does not support peephole tensor, #ifdef directive TEST_LSTM_NONEP_ONLY are added in test/numerial/TestLSTM.cpp and set in the CMakeLists. Currently bidirectinal LSTM is not supported in NNPA, so, it is disabled by using #ifdef directive TEST_RNN_NO_BIDIR.
  • GRU Since GRU of zDNN library does not support LinearBeforeReset, #ifdef directive TEST_GRU_L1 are added in test/numerial/TestGRU.cpp and set in the CMakeLists. Currently bidirectinal LSTM is not supported in NNPA, so, it is disabled by using #ifdef directive TEST_RNN_NO_BIDIR.