Port TVM to support GIGO hw

[DemonGiggle]

GIGO hw support

Well, I try to write a minimal implementation for a new (non-existed) hw porting.

List of supported operators for the GIGO hw:

• nn.conv2d (software simulated)

Steps & example to use GIGO hw

• Create build folder in the tvm root directory
• Copy cmake/config.cmake to build
• Change the setting USE_GIGO in build/config.cmake to "ON"
• Make the whole project

Now, with this simple file, we can see what had been changed by GIGO relay backend, by comparing the relay IR output.

from __future__ import absolute_import, print_function

import tvm
from tvm import te
import numpy as np
from tvm import relay
import tflite

def output(filename, content):
    with open(filename, "w") as f:
        f.write(content)

model_buf = open("mobilenet.tflite", "rb").read()

tflite_model = tflite.Model.GetRootAsModel(model_buf, 0)

# TFLite input tensor name, shape and type
input_tensor = "input"
input_shape = (1, 224, 224, 3)
input_dtype = "float32"

# Parse TFLite model and convert it to a Relay module
mod, params = relay.frontend.from_tflite(tflite_model,
        shape_dict={input_tensor: input_shape},
        dtype_dict={input_tensor: input_dtype})
output("relay_ir.before.txt", str(mod))

# Partition with gigo
mod = relay.op.contrib.gigo.partition_for_gigo(mod)
output("relay_ir.after.txt", str(mod))

relay_ir.before.txt looks like:

def @main(...) {
  %0 = nn.conv2d(...)
  %1 = nn.bias_add(%0, ...)
  %2 = nn.conv2d(%1, ...)
  ...
}

relay_ir.after.txt looks like:

def @gigo_0(...) {
  nn.conv2d(...)
}

def @gigo_2(...) {
  nn.conv2d(...)
}

def @main(...) {
  %0 = @gigo_0(...)
  %1 = @nn.bias_add(%0, ...)
  %2 = @gigo_2(%1, ...)
}

By comparing the two files, we know that the operator GIGO supports will be replaced with another wrapper function.

[DemonGiggle]

Attach file is the example to use GIGO hw

gigo_hw.zip

[DemonGiggle]

Attach file is the example to use GIGO hw

gigo_hw.zip

This one miss the weight info when building device kernel code.
I upload the correct version.

gigo_hw_correct_weights_in.zip