[Testing][v0.3] Add TVM installation for testing Relay+HeteroCL with …

…CircleCI (#145) * [API] Enable building a function directly from IR (#133) * add a pass for building a function directly from IR * remove redundant print statement * [API] Enable select API to accept Python expressions * [API] Fixed incorrect casting for select in CastRemover * [API][Backend] Streaming and OpenCL Backends (#138) * add sdaccel, aocl for heterocl * fpga * Create codeanalys_openclc.cc * Update target.py * run * can run successfully * Create codegen_opencl.cc * now * all done * Update codegen_sdaccel.cc * Update codegen_sdaccel.cc * modified: python/heterocl/tvm/target.py * new file: samples/ppac/gemm/csrcPrint.py new file: samples/ppac/gemm/data.py new file: samples/ppac/gemm/gemm_ppac.py new file: samples/ppac/gemm/headcode.txt new file: samples/ppac/gemm/ppac_common.py new file: tvm/src/codegen/build_ppac.cc new file: tvm/src/codegen/codegen_rv64_ppac.cc new file: tvm/src/codegen/codegen_rv64_ppac.h * all * remove tvm check code from kernel * opencl-backend * all * fix ppac module build * support ppac MVPb pragma * fix ignoring ppac pragma in cpu backend * opencl-backend * aocl-backend * move ppac codegen to ppac folder; fix argument name with merlinc analyser * discard the new for-loop type; include ppac in hlib * discard some previous changes * Use int64_t as return type of GeMM on ppac * [add] codegenc kernedef + stream init * [add] var_shape_map * [update] kerneldef struct shape * [update] use noderef and restore * [fix] return op * [add] hcl device & kernelstmt printer * [fix] def workaround * [update] stream example * [add] stream expr & stmt ir * [fix] kernel arg location for stream * opt1 * opencl-general * new-version * no bug * a * test+unroll+pipeline * pragma * new * type has fixed * new_test * test_reorder_split_fuse * target * order * simplified by rui * analysis * bug fixed * [delete] all of the code about opencl * [ADD] new opencl back-end including xilinx & intel * fixed __local * fixed data_type for xilinx opencl * add makefile for SDAccel_runtime * add the runtime for sdaccel * create the sdaccel host * fixed the indent problem partly * test the zhang-05 server * add indent to the host.cpp * automatically generate makefile * delete common folder from opencl * add shmat to sdaccel runtime * fixed bug for sdaccel runtime seg fault * fixed the bug of host.cpp multiple * fixed host.cpp multiple bug * fixed endif for makefile * modify sdaccel_sw_emu -> sdaccel_csim * fix the __local and __global for intel opencl back-end * Fix the arbitrary integer precision for aocl * [add] ir visitor & functor for codegen * [add] aocl stream codegen * [add] aocl stream support * [fix] aocl type conversion * [fix] aocl channel syntax * [add] sch.stream_to * [fix] add stream annotation * [add] host device codegen * [add] stream ir mutator * [Add] Interface prag,a for SDx sim * [add] host xcel codegen * [update] build interface * [update] new build interface * [fix] temp update * [update] stream example * [add] rocc-ppac sim * [rm] submodule * [update] rocc ppac hlib * [add] unified sim & kernel updater * re-organize build common util * [update] stream in codegen c * [update] codegen construct for streaming * [update] code post-processing * [fix] test cases * [fix] python compatibility * [update] future * [fix] metaclass * [fix] test import issue * Revert "[API][Backend] Streaming and OpenCL Backends (#138)" (#139) This reverts commit 2c75344. * [API] Remove support for Python 2 (#143) * remove support for Python 2 * switch from Python 3.7 to 3.6 * add tvm installation * wrong directory * fix path * set USE_LLVM OFF for tvm Co-authored-by: Shaojie Xiang <[email protected]>
cornell-zhang · Jan 13, 2020 · 620c03c · 620c03c
1 parent 328784c
commit 620c03c
Show file tree

Hide file tree

Showing 3 changed files with 210 additions and 9 deletions.
diff --git a/.circleci/config.cmake b/.circleci/config.cmake
@@ -0,0 +1,198 @@
+# Licensed to the Apache Software Foundation (ASF) under one
+# or more contributor license agreements.  See the NOTICE file
+# distributed with this work for additional information
+# regarding copyright ownership.  The ASF licenses this file
+# to you under the Apache License, Version 2.0 (the
+# "License"); you may not use this file except in compliance
+# with the License.  You may obtain a copy of the License at
+#
+#   http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing,
+# software distributed under the License is distributed on an
+# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+# KIND, either express or implied.  See the License for the
+# specific language governing permissions and limitations
+# under the License.
+
+#--------------------------------------------------------------------
+#  Template custom cmake configuration for compiling
+#
+#  This file is used to override the build options in build.
+#  If you want to change the configuration, please use the following
+#  steps. Assume you are on the root directory. First copy the this
+#  file so that any local changes will be ignored by git
+#
+#  $ mkdir build
+#  $ cp cmake/config.cmake build
+#
+#  Next modify the according entries, and then compile by
+#
+#  $ cd build
+#  $ cmake ..
+#
+#  Then build in parallel with 8 threads
+#
+#  $ make -j8
+#--------------------------------------------------------------------
+
+#---------------------------------------------
+# Backend runtimes.
+#---------------------------------------------
+
+# Whether enable CUDA during compile,
+#
+# Possible values:
+# - ON: enable CUDA with cmake's auto search
+# - OFF: disable CUDA
+# - /path/to/cuda: use specific path to cuda toolkit
+set(USE_CUDA OFF)
+
+# Whether enable ROCM runtime
+#
+# Possible values:
+# - ON: enable ROCM with cmake's auto search
+# - OFF: disable ROCM
+# - /path/to/rocm: use specific path to rocm
+set(USE_ROCM OFF)
+
+# Whether enable SDAccel runtime
+set(USE_SDACCEL OFF)
+
+# Whether enable Intel FPGA SDK for OpenCL (AOCL) runtime
+set(USE_AOCL OFF)
+
+# Whether enable OpenCL runtime
+set(USE_OPENCL OFF)
+
+# Whether enable Metal runtime
+set(USE_METAL OFF)
+
+# Whether enable Vulkan runtime
+#
+# Possible values:
+# - ON: enable Vulkan with cmake's auto search
+# - OFF: disable vulkan
+# - /path/to/vulkan-sdk: use specific path to vulkan-sdk
+set(USE_VULKAN OFF)
+
+# Whether enable OpenGL runtime
+set(USE_OPENGL OFF)
+
+# Whether enable MicroTVM runtime
+set(USE_MICRO OFF)
+
+# Whether to enable SGX runtime
+#
+# Possible values for USE_SGX:
+# - /path/to/sgxsdk: path to Intel SGX SDK
+# - OFF: disable SGX
+#
+# SGX_MODE := HW|SIM
+set(USE_SGX OFF)
+set(SGX_MODE "SIM")
+set(RUST_SGX_SDK "/path/to/rust-sgx-sdk")
+
+# Whether enable RPC runtime
+set(USE_RPC ON)
+
+# Whether embed stackvm into the runtime
+set(USE_STACKVM_RUNTIME OFF)
+
+# Whether enable tiny embedded graph runtime.
+set(USE_GRAPH_RUNTIME ON)
+
+# Whether enable additional graph debug functions
+set(USE_GRAPH_RUNTIME_DEBUG OFF)
+
+# Whether enable additional vm profiler functions
+set(USE_VM_PROFILER OFF)
+
+# Whether enable uTVM standalone runtime
+set(USE_MICRO_STANDALONE_RUNTIME OFF)
+
+# Whether build with LLVM support
+# Requires LLVM version >= 4.0
+#
+# Possible values:
+# - ON: enable llvm with cmake's find search
+# - OFF: disable llvm
+# - /path/to/llvm-config: enable specific LLVM when multiple llvm-dev is available.
+set(USE_LLVM OFF)
+
+#---------------------------------------------
+# Contrib libraries
+#---------------------------------------------
+# Whether use BLAS, choices: openblas, mkl, atlas, apple
+set(USE_BLAS none)
+
+# /path/to/mkl: mkl root path when use mkl blas library
+# set(USE_MKL_PATH /opt/intel/mkl) for UNIX
+# set(USE_MKL_PATH ../IntelSWTools/compilers_and_libraries_2018/windows/mkl) for WIN32
+# set(USE_MKL_PATH <path to venv or site-packages directory>) if using `pip install mkl`
+set(USE_MKL_PATH none)
+
+# Whether use MKLDNN library
+set(USE_MKLDNN OFF)
+
+# Whether use OpenMP thread pool, choices: gnu, intel
+# Note: "gnu" uses gomp library, "intel" uses iomp5 library
+set(USE_OPENMP none)
+
+# Whether use contrib.random in runtime
+set(USE_RANDOM OFF)
+
+# Whether use NNPack
+set(USE_NNPACK OFF)
+
+# Possible values:
+# - ON: enable tflite with cmake's find search
+# - OFF: disable tflite
+# - /path/to/libtensorflow-lite.a: use specific path to tensorflow lite library 
+set(USE_TFLITE OFF)
+
+# /path/to/tensorflow: tensorflow root path when use tflite library
+set(USE_TENSORFLOW_PATH none)
+
+# Whether use CuDNN
+set(USE_CUDNN OFF)
+
+# Whether use cuBLAS
+set(USE_CUBLAS OFF)
+
+# Whether use MIOpen
+set(USE_MIOPEN OFF)
+
+# Whether use MPS
+set(USE_MPS OFF)
+
+# Whether use rocBlas
+set(USE_ROCBLAS OFF)
+
+# Whether use contrib sort
+set(USE_SORT ON)
+
+# Whether use MKL-DNN (DNNL) codegen
+set(USE_DNNL_CODEGEN OFF)
+
+# Build ANTLR parser for Relay text format
+# Possible values:
+# - ON: enable ANTLR by searching default locations (cmake find_program for antlr4 and /usr/local for jar)
+# - OFF: disable ANTLR
+# - /path/to/antlr-*-complete.jar: path to specific ANTLR jar file
+set(USE_ANTLR OFF)
+
+# Whether use Relay debug mode
+set(USE_RELAY_DEBUG OFF)
+
+# Whether to build fast VTA simulator driver
+set(USE_VTA_FSIM ON)
+
+# Whether to build cycle-accurate VTA simulator driver
+set(USE_VTA_TSIM ON)
+
+# Whether to build VTA FPGA driver (device side only)
+set(USE_VTA_FPGA OFF)
+
+# Whether to build the example external runtime module
+set(USE_EXAMPLE_EXT_RUNTIME OFF)
diff --git a/.circleci/config.yml b/.circleci/config.yml
@@ -10,6 +10,7 @@ test: &test
     - restore_cache:
         key: v1.03-libhcl-
     - run: make build-python
+    - run: source .circleci/install_tvm.sh
     - run: pip install --user pytest 
     - run: pip install --user future 
     - run: python -m pytest tests
@@ -20,7 +21,7 @@ version: 2
 jobs:
   build-hcl:
     docker:
-      - image: circleci/python:2.7
+      - image: circleci/python:3.6
     steps:
       - checkout
       - restore_cache:
@@ -34,22 +35,15 @@ jobs:
           key: v1.03-libhcl-{{ checksum "tvm/lib/libhcl.so" }}-{{ checksum "tvm/lib/libhcl_runtime.so" }}
           paths:
             - ~/project/tvm/lib
-  test-python-2:
-    docker:
-      - image: circleci/python:2.7
-    <<: *test
   test-python-3:
     docker:
-      - image: circleci/python:3.7
+      - image: circleci/python:3.6
     <<: *test
 workflows:
   version: 2
   build-pythons:
     jobs:
       - build-hcl
-      - test-python-2:
-          requires: 
-            - build-hcl
       - test-python-3:
           requires: 
             - build-hcl
diff --git a/.circleci/install_tvm.sh b/.circleci/install_tvm.sh
@@ -0,0 +1,9 @@
+#!/bin/bash
+git clone --recursive https://github.com/apache/incubator-tvm tvm-origin
+cd tvm-origin
+mkdir build
+cp ../.circleci/config.cmake build
+cd build
+~/project/build/pkgs/cmake/build/cmake/bin/cmake ..
+make -j4
+cd ../python; python setup.py install --user; cd ..