diff --git a/docs/_notebooks/Resnet50-example.html b/docs/_notebooks/Resnet50-example.html index 0024c8873f..13cdf8ad2e 100644 --- a/docs/_notebooks/Resnet50-example.html +++ b/docs/_notebooks/Resnet50-example.html @@ -690,7 +690,7 @@

- 832f033f9337487ba7868b45ff52e9fe + 0904ed52551d45acab1d028795d47df1

TRTorch Getting Started - ResNet 50 diff --git a/docs/_notebooks/lenet-getting-started.html b/docs/_notebooks/lenet-getting-started.html index a2f3243b0e..6fb0bd1af1 100644 --- a/docs/_notebooks/lenet-getting-started.html +++ b/docs/_notebooks/lenet-getting-started.html @@ -784,7 +784,7 @@

- a469a5f1dc3245c091eb0097581de724 + eb83af0673044a89b9357bb998acd927

TRTorch Getting Started - LeNet diff --git a/docs/_notebooks/ssd-object-detection-demo.html b/docs/_notebooks/ssd-object-detection-demo.html index f8353a24ba..8d8786976d 100644 --- a/docs/_notebooks/ssd-object-detection-demo.html +++ b/docs/_notebooks/ssd-object-detection-demo.html @@ -804,7 +804,7 @@

- 6fee1a4f09854ba1a11aed1c38759f74 + 092b8936ef17484f92965a48c4cdea98

Object Detection with TRTorch (SSD) diff --git a/docs/_sources/tutorials/ptq.rst.txt b/docs/_sources/tutorials/ptq.rst.txt index 28d60acec3..48f42c3604 100644 --- a/docs/_sources/tutorials/ptq.rst.txt +++ b/docs/_sources/tutorials/ptq.rst.txt @@ -14,14 +14,17 @@ the TensorRT calibrator. With TRTorch we look to leverage existing infrastructur calibrators easier. LibTorch provides a ``DataLoader`` and ``Dataset`` API which steamlines preprocessing and batching input data. -This section of the PyTorch documentation has more information https://pytorch.org/tutorials/advanced/cpp_frontend.html#loading-data. +These APIs are exposed via both C++ and Python interface which makes it easier for the end user. +For C++ interface, we use ``torch::Dataset`` and ``torch::data::make_data_loader`` objects to construct and perform pre-processing on datasets. +The equivalent functionality in python interface uses ``torch.utils.data.Dataset`` and ``torch.utils.data.DataLoader``. +This section of the PyTorch documentation has more information https://pytorch.org/tutorials/advanced/cpp_frontend.html#loading-data and https://pytorch.org/tutorials/recipes/recipes/loading_data_recipe.html. TRTorch uses Dataloaders as the base of a generic calibrator implementation. So you will be able to reuse or quickly implement a ``torch::Dataset`` for your target domain, place it in a DataLoader and create a INT8 Calibrator which you can provide to TRTorch to run INT8 Calibration during compliation of your module. -.. _writing_ptq: +.. _writing_ptq_cpp: -How to create your own PTQ application +How to create your own PTQ application in C++ ---------------------------------------- Here is an example interface of a ``torch::Dataset`` class for CIFAR10: @@ -132,14 +135,76 @@ Then all thats required to setup the module for INT8 calibration is to set the f auto trt_mod = trtorch::CompileGraph(mod, compile_spec); If you have an existing Calibrator implementation for TensorRT you may directly set the ``ptq_calibrator`` field with a pointer to your calibrator and it will work as well. - From here not much changes in terms of how to execution works. You are still able to fully use LibTorch as the sole interface for inference. Data should remain in FP32 precision when it's passed into `trt_mod.forward`. There exists an example application in the TRTorch demo that takes you from training a VGG16 network on CIFAR10 to deploying in INT8 with TRTorch here: https://github.com/NVIDIA/TRTorch/tree/master/cpp/ptq +.. _writing_ptq_python: + +How to create your own PTQ application in Python +---------------------------------------- + +TRTorch Python API provides an easy and convenient way to use pytorch dataloaders with TensorRT calibrators. ``DataLoaderCalibrator`` class can be used to create +a TensorRT calibrator by providing desired configuration. The following code demonstrates an example on how to use it + +.. code-block:: python + + testing_dataset = torchvision.datasets.CIFAR10(root='./data', + train=False, + download=True, + transform=transforms.Compose([ + transforms.ToTensor(), + transforms.Normalize((0.4914, 0.4822, 0.4465), + (0.2023, 0.1994, 0.2010)) + ])) + + testing_dataloader = torch.utils.data.DataLoader(testing_dataset, + batch_size=1, + shuffle=False, + num_workers=1) + calibrator = trtorch.ptq.DataLoaderCalibrator(testing_dataloader, + cache_file='./calibration.cache', + use_cache=False, + algo_type=trtorch.ptq.CalibrationAlgo.ENTROPY_CALIBRATION_2, + device=torch.device('cuda:0')) + + compile_spec = { + "input_shapes": [[1, 3, 32, 32]], + "op_precision": torch.int8, + "calibrator": calibrator, + "device": { + "device_type": trtorch.DeviceType.GPU, + "gpu_id": 0, + "dla_core": 0, + "allow_gpu_fallback": False, + "disable_tf32": False + } + } + trt_mod = trtorch.compile(model, compile_spec) + +In the cases where there is a pre-existing calibration cache file that users want to use, ``CacheCalibrator`` can be used without any dataloaders. The following example demonstrates how +to use ``CacheCalibrator`` to use in INT8 mode. + +.. code-block:: python + + calibrator = trtorch.ptq.CacheCalibrator("./calibration.cache") + + compile_settings = { + "input_shapes": [[1, 3, 32, 32]], + "op_precision": torch.int8, + "calibrator": calibrator, + "max_batch_size": 32, + } + + trt_mod = trtorch.compile(model, compile_settings) + +If you already have an existing calibrator class (implemented directly using TensorRT API), you can directly set the calibrator field to your class which can be very convenient. +For a demo on how PTQ can be performed on a VGG network using TRTorch API, you can refer to https://github.com/NVIDIA/TRTorch/blob/master/tests/py/test_ptq_dataloader_calibrator.py +and https://github.com/NVIDIA/TRTorch/blob/master/tests/py/test_ptq_trt_calibrator.py + Citations ^^^^^^^^^^^ Krizhevsky, A., & Hinton, G. (2009). Learning multiple layers of features from tiny images. -Simonyan, K., & Zisserman, A. (2014). Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556. +Simonyan, K., & Zisserman, A. (2014). Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556. \ No newline at end of file diff --git a/docs/objects.inv b/docs/objects.inv index 5a05171d6d..b33fd94bb8 100644 Binary files a/docs/objects.inv and b/docs/objects.inv differ diff --git a/docs/py_api/trtorch.html b/docs/py_api/trtorch.html index e20123f260..1996a8a087 100644 --- a/docs/py_api/trtorch.html +++ b/docs/py_api/trtorch.html @@ -1011,7 +1011,7 @@

) - → <torch._C.ScriptClass object at 0x7fb41dd1c618> + → <torch._C.ScriptClass object at 0x7fb23f032618> diff --git a/docs/searchindex.js b/docs/searchindex.js index 74c6bfa833..cd77d0d06a 100644 --- a/docs/searchindex.js +++ b/docs/searchindex.js @@ -1 +1 @@ -Search.setIndex({docnames:["_cpp_api/class_view_hierarchy","_cpp_api/classtrtorch_1_1CompileSpec_1_1DataType","_cpp_api/classtrtorch_1_1CompileSpec_1_1Device_1_1DeviceType","_cpp_api/classtrtorch_1_1ptq_1_1Int8CacheCalibrator","_cpp_api/classtrtorch_1_1ptq_1_1Int8Calibrator","_cpp_api/define_macros_8h_1a18d295a837ac71add5578860b55e5502","_cpp_api/define_macros_8h_1a20c1fbeb21757871c52299dc52351b5f","_cpp_api/define_macros_8h_1a25ee153c325dfc7466a33cbd5c1ff055","_cpp_api/define_macros_8h_1a48d6029a45583a06848891cb0e86f7ba","_cpp_api/define_macros_8h_1a71b02dddfabe869498ad5a88e11c440f","_cpp_api/define_macros_8h_1a9d31d0569348d109b1b069b972dd143e","_cpp_api/define_macros_8h_1abe87b341f562fd1cf40b7672e4d759da","_cpp_api/define_macros_8h_1ae1c56ab8a40af292a9a4964651524d84","_cpp_api/dir_cpp","_cpp_api/dir_cpp_api","_cpp_api/dir_cpp_api_include","_cpp_api/dir_cpp_api_include_trtorch","_cpp_api/enum_logging_8h_1a5f612ff2f783ff4fbe89d168f0d817d4","_cpp_api/file_cpp_api_include_trtorch_logging.h","_cpp_api/file_cpp_api_include_trtorch_macros.h","_cpp_api/file_cpp_api_include_trtorch_ptq.h","_cpp_api/file_cpp_api_include_trtorch_trtorch.h","_cpp_api/file_view_hierarchy","_cpp_api/function_logging_8h_1a118d65b179defff7fff279eb9cd126cb","_cpp_api/function_logging_8h_1a396a688110397538f8b3fb7dfdaf38bb","_cpp_api/function_logging_8h_1a9b420280bfacc016d7e36a5704021949","_cpp_api/function_logging_8h_1aa533955a2b908db9e5df5acdfa24715f","_cpp_api/function_logging_8h_1abc57d473f3af292551dee8b9c78373ad","_cpp_api/function_logging_8h_1adf5435f0dbb09c0d931a1b851847236b","_cpp_api/function_logging_8h_1aef44b69c62af7cf2edc8875a9506641a","_cpp_api/function_ptq_8h_1a4422781719d7befedb364cacd91c6247","_cpp_api/function_ptq_8h_1a5f33b142bc2f3f2aaf462270b3ad7e31","_cpp_api/function_trtorch_8h_1a2cf17d43ba9117b3b4d652744b4f0447","_cpp_api/function_trtorch_8h_1a3eace458ae9122f571fabfc9ef1b9e3a","_cpp_api/function_trtorch_8h_1a589ea96d16e2df44146ad0919424e00e","_cpp_api/function_trtorch_8h_1a726f6e7091b6b7be45b5a4275b2ffb10","_cpp_api/function_trtorch_8h_1ab01696cfe08b6a5293c55935a9713c25","_cpp_api/function_trtorch_8h_1af19cb866b0520fc84b69a1cf25a52b65","_cpp_api/namespace_trtorch","_cpp_api/namespace_trtorch__logging","_cpp_api/namespace_trtorch__ptq","_cpp_api/program_listing_file_cpp_api_include_trtorch_logging.h","_cpp_api/program_listing_file_cpp_api_include_trtorch_macros.h","_cpp_api/program_listing_file_cpp_api_include_trtorch_ptq.h","_cpp_api/program_listing_file_cpp_api_include_trtorch_trtorch.h","_cpp_api/structtrtorch_1_1CompileSpec","_cpp_api/structtrtorch_1_1CompileSpec_1_1Device","_cpp_api/structtrtorch_1_1CompileSpec_1_1InputRange","_cpp_api/trtorch_cpp","_cpp_api/unabridged_api","_cpp_api/unabridged_orphan","_notebooks/Resnet50-example","_notebooks/lenet-getting-started","_notebooks/ssd-object-detection-demo","contributors/conversion","contributors/lowering","contributors/phases","contributors/runtime","contributors/system_overview","contributors/useful_links","contributors/writing_converters","index","indices/supported_ops","py_api/logging","py_api/trtorch","tutorials/getting_started","tutorials/installation","tutorials/ptq","tutorials/runtime","tutorials/trtorchc","tutorials/use_from_pytorch","tutorials/using_dla"],envversion:{"sphinx.domains.c":2,"sphinx.domains.changeset":1,"sphinx.domains.citation":1,"sphinx.domains.cpp":3,"sphinx.domains.index":1,"sphinx.domains.javascript":2,"sphinx.domains.math":2,"sphinx.domains.python":2,"sphinx.domains.rst":2,"sphinx.domains.std":1,"sphinx.ext.intersphinx":1,nbsphinx:3,sphinx:56},filenames:["_cpp_api/class_view_hierarchy.rst","_cpp_api/classtrtorch_1_1CompileSpec_1_1DataType.rst","_cpp_api/classtrtorch_1_1CompileSpec_1_1Device_1_1DeviceType.rst","_cpp_api/classtrtorch_1_1ptq_1_1Int8CacheCalibrator.rst","_cpp_api/classtrtorch_1_1ptq_1_1Int8Calibrator.rst","_cpp_api/define_macros_8h_1a18d295a837ac71add5578860b55e5502.rst","_cpp_api/define_macros_8h_1a20c1fbeb21757871c52299dc52351b5f.rst","_cpp_api/define_macros_8h_1a25ee153c325dfc7466a33cbd5c1ff055.rst","_cpp_api/define_macros_8h_1a48d6029a45583a06848891cb0e86f7ba.rst","_cpp_api/define_macros_8h_1a71b02dddfabe869498ad5a88e11c440f.rst","_cpp_api/define_macros_8h_1a9d31d0569348d109b1b069b972dd143e.rst","_cpp_api/define_macros_8h_1abe87b341f562fd1cf40b7672e4d759da.rst","_cpp_api/define_macros_8h_1ae1c56ab8a40af292a9a4964651524d84.rst","_cpp_api/dir_cpp.rst","_cpp_api/dir_cpp_api.rst","_cpp_api/dir_cpp_api_include.rst","_cpp_api/dir_cpp_api_include_trtorch.rst","_cpp_api/enum_logging_8h_1a5f612ff2f783ff4fbe89d168f0d817d4.rst","_cpp_api/file_cpp_api_include_trtorch_logging.h.rst","_cpp_api/file_cpp_api_include_trtorch_macros.h.rst","_cpp_api/file_cpp_api_include_trtorch_ptq.h.rst","_cpp_api/file_cpp_api_include_trtorch_trtorch.h.rst","_cpp_api/file_view_hierarchy.rst","_cpp_api/function_logging_8h_1a118d65b179defff7fff279eb9cd126cb.rst","_cpp_api/function_logging_8h_1a396a688110397538f8b3fb7dfdaf38bb.rst","_cpp_api/function_logging_8h_1a9b420280bfacc016d7e36a5704021949.rst","_cpp_api/function_logging_8h_1aa533955a2b908db9e5df5acdfa24715f.rst","_cpp_api/function_logging_8h_1abc57d473f3af292551dee8b9c78373ad.rst","_cpp_api/function_logging_8h_1adf5435f0dbb09c0d931a1b851847236b.rst","_cpp_api/function_logging_8h_1aef44b69c62af7cf2edc8875a9506641a.rst","_cpp_api/function_ptq_8h_1a4422781719d7befedb364cacd91c6247.rst","_cpp_api/function_ptq_8h_1a5f33b142bc2f3f2aaf462270b3ad7e31.rst","_cpp_api/function_trtorch_8h_1a2cf17d43ba9117b3b4d652744b4f0447.rst","_cpp_api/function_trtorch_8h_1a3eace458ae9122f571fabfc9ef1b9e3a.rst","_cpp_api/function_trtorch_8h_1a589ea96d16e2df44146ad0919424e00e.rst","_cpp_api/function_trtorch_8h_1a726f6e7091b6b7be45b5a4275b2ffb10.rst","_cpp_api/function_trtorch_8h_1ab01696cfe08b6a5293c55935a9713c25.rst","_cpp_api/function_trtorch_8h_1af19cb866b0520fc84b69a1cf25a52b65.rst","_cpp_api/namespace_trtorch.rst","_cpp_api/namespace_trtorch__logging.rst","_cpp_api/namespace_trtorch__ptq.rst","_cpp_api/program_listing_file_cpp_api_include_trtorch_logging.h.rst","_cpp_api/program_listing_file_cpp_api_include_trtorch_macros.h.rst","_cpp_api/program_listing_file_cpp_api_include_trtorch_ptq.h.rst","_cpp_api/program_listing_file_cpp_api_include_trtorch_trtorch.h.rst","_cpp_api/structtrtorch_1_1CompileSpec.rst","_cpp_api/structtrtorch_1_1CompileSpec_1_1Device.rst","_cpp_api/structtrtorch_1_1CompileSpec_1_1InputRange.rst","_cpp_api/trtorch_cpp.rst","_cpp_api/unabridged_api.rst","_cpp_api/unabridged_orphan.rst","_notebooks/Resnet50-example.ipynb","_notebooks/lenet-getting-started.ipynb","_notebooks/ssd-object-detection-demo.ipynb","contributors/conversion.rst","contributors/lowering.rst","contributors/phases.rst","contributors/runtime.rst","contributors/system_overview.rst","contributors/useful_links.rst","contributors/writing_converters.rst","index.rst","indices/supported_ops.rst","py_api/logging.rst","py_api/trtorch.rst","tutorials/getting_started.rst","tutorials/installation.rst","tutorials/ptq.rst","tutorials/runtime.rst","tutorials/trtorchc.rst","tutorials/use_from_pytorch.rst","tutorials/using_dla.rst"],objects:{"":{"trtorch::CheckMethodOperatorSupport":[36,1,1,"_CPPv4N7trtorch26CheckMethodOperatorSupportERKN5torch3jit6ModuleENSt6stringE"],"trtorch::CheckMethodOperatorSupport::method_name":[36,2,1,"_CPPv4N7trtorch26CheckMethodOperatorSupportERKN5torch3jit6ModuleENSt6stringE"],"trtorch::CheckMethodOperatorSupport::module":[36,2,1,"_CPPv4N7trtorch26CheckMethodOperatorSupportERKN5torch3jit6ModuleENSt6stringE"],"trtorch::CompileGraph":[33,1,1,"_CPPv4N7trtorch12CompileGraphERKN5torch3jit6ModuleE11CompileSpec"],"trtorch::CompileGraph::info":[33,2,1,"_CPPv4N7trtorch12CompileGraphERKN5torch3jit6ModuleE11CompileSpec"],"trtorch::CompileGraph::module":[33,2,1,"_CPPv4N7trtorch12CompileGraphERKN5torch3jit6ModuleE11CompileSpec"],"trtorch::CompileSpec":[45,3,1,"_CPPv4N7trtorch11CompileSpecE"],"trtorch::CompileSpec::CompileSpec":[45,1,1,"_CPPv4N7trtorch11CompileSpec11CompileSpecENSt6vectorINSt6vectorI7int64_tEEEE"],"trtorch::CompileSpec::CompileSpec::fixed_sizes":[45,2,1,"_CPPv4N7trtorch11CompileSpec11CompileSpecENSt6vectorINSt6vectorI7int64_tEEEE"],"trtorch::CompileSpec::CompileSpec::input_ranges":[45,2,1,"_CPPv4N7trtorch11CompileSpec11CompileSpecENSt6vectorI10InputRangeEE"],"trtorch::CompileSpec::DataType":[45,3,1,"_CPPv4N7trtorch11CompileSpec8DataTypeE"],"trtorch::CompileSpec::DataType::DataType":[45,1,1,"_CPPv4N7trtorch11CompileSpec8DataType8DataTypeEv"],"trtorch::CompileSpec::DataType::DataType::t":[45,2,1,"_CPPv4N7trtorch11CompileSpec8DataType8DataTypeEN3c1010ScalarTypeE"],"trtorch::CompileSpec::DataType::Value":[45,4,1,"_CPPv4N7trtorch11CompileSpec8DataType5ValueE"],"trtorch::CompileSpec::DataType::Value::kChar":[45,5,1,"_CPPv4N7trtorch11CompileSpec8DataType5Value5kCharE"],"trtorch::CompileSpec::DataType::Value::kFloat":[45,5,1,"_CPPv4N7trtorch11CompileSpec8DataType5Value6kFloatE"],"trtorch::CompileSpec::DataType::Value::kHalf":[45,5,1,"_CPPv4N7trtorch11CompileSpec8DataType5Value5kHalfE"],"trtorch::CompileSpec::DataType::kChar":[1,5,1,"_CPPv4N7trtorch11CompileSpec8DataType5Value5kCharE"],"trtorch::CompileSpec::DataType::kFloat":[1,5,1,"_CPPv4N7trtorch11CompileSpec8DataType5Value6kFloatE"],"trtorch::CompileSpec::DataType::kHalf":[1,5,1,"_CPPv4N7trtorch11CompileSpec8DataType5Value5kHalfE"],"trtorch::CompileSpec::DataType::operator Value":[45,1,1,"_CPPv4NK7trtorch11CompileSpec8DataTypecv5ValueEv"],"trtorch::CompileSpec::DataType::operator bool":[45,1,1,"_CPPv4N7trtorch11CompileSpec8DataTypecvbEv"],"trtorch::CompileSpec::DataType::operator!=":[45,1,1,"_CPPv4NK7trtorch11CompileSpec8DataTypeneEN8DataType5ValueE"],"trtorch::CompileSpec::DataType::operator!=::other":[45,2,1,"_CPPv4NK7trtorch11CompileSpec8DataTypeneEN8DataType5ValueE"],"trtorch::CompileSpec::DataType::operator==":[45,1,1,"_CPPv4NK7trtorch11CompileSpec8DataTypeeqEN8DataType5ValueE"],"trtorch::CompileSpec::DataType::operator==::other":[45,2,1,"_CPPv4NK7trtorch11CompileSpec8DataTypeeqEN8DataType5ValueE"],"trtorch::CompileSpec::Device":[46,3,1,"_CPPv4N7trtorch11CompileSpec6DeviceE"],"trtorch::CompileSpec::Device::Device":[46,1,1,"_CPPv4N7trtorch11CompileSpec6Device6DeviceEv"],"trtorch::CompileSpec::Device::DeviceType":[46,3,1,"_CPPv4N7trtorch11CompileSpec6Device10DeviceTypeE"],"trtorch::CompileSpec::Device::DeviceType::DeviceType":[46,1,1,"_CPPv4N7trtorch11CompileSpec6Device10DeviceType10DeviceTypeEv"],"trtorch::CompileSpec::Device::DeviceType::DeviceType::t":[46,2,1,"_CPPv4N7trtorch11CompileSpec6Device10DeviceType10DeviceTypeEN3c1010DeviceTypeE"],"trtorch::CompileSpec::Device::DeviceType::Value":[46,4,1,"_CPPv4N7trtorch11CompileSpec6Device10DeviceType5ValueE"],"trtorch::CompileSpec::Device::DeviceType::Value::kDLA":[46,5,1,"_CPPv4N7trtorch11CompileSpec6Device10DeviceType5Value4kDLAE"],"trtorch::CompileSpec::Device::DeviceType::Value::kGPU":[46,5,1,"_CPPv4N7trtorch11CompileSpec6Device10DeviceType5Value4kGPUE"],"trtorch::CompileSpec::Device::DeviceType::kDLA":[2,5,1,"_CPPv4N7trtorch11CompileSpec6Device10DeviceType5Value4kDLAE"],"trtorch::CompileSpec::Device::DeviceType::kGPU":[2,5,1,"_CPPv4N7trtorch11CompileSpec6Device10DeviceType5Value4kGPUE"],"trtorch::CompileSpec::Device::DeviceType::operator Value":[46,1,1,"_CPPv4NK7trtorch11CompileSpec6Device10DeviceTypecv5ValueEv"],"trtorch::CompileSpec::Device::DeviceType::operator bool":[46,1,1,"_CPPv4N7trtorch11CompileSpec6Device10DeviceTypecvbEv"],"trtorch::CompileSpec::Device::DeviceType::operator!=":[46,1,1,"_CPPv4NK7trtorch11CompileSpec6Device10DeviceTypeneE10DeviceType"],"trtorch::CompileSpec::Device::DeviceType::operator!=::other":[46,2,1,"_CPPv4NK7trtorch11CompileSpec6Device10DeviceTypeneE10DeviceType"],"trtorch::CompileSpec::Device::DeviceType::operator==":[46,1,1,"_CPPv4NK7trtorch11CompileSpec6Device10DeviceTypeeqE10DeviceType"],"trtorch::CompileSpec::Device::DeviceType::operator==::other":[46,2,1,"_CPPv4NK7trtorch11CompileSpec6Device10DeviceTypeeqE10DeviceType"],"trtorch::CompileSpec::Device::allow_gpu_fallback":[46,6,1,"_CPPv4N7trtorch11CompileSpec6Device18allow_gpu_fallbackE"],"trtorch::CompileSpec::Device::device_type":[46,6,1,"_CPPv4N7trtorch11CompileSpec6Device11device_typeE"],"trtorch::CompileSpec::Device::dla_core":[46,6,1,"_CPPv4N7trtorch11CompileSpec6Device8dla_coreE"],"trtorch::CompileSpec::Device::gpu_id":[46,6,1,"_CPPv4N7trtorch11CompileSpec6Device6gpu_idE"],"trtorch::CompileSpec::EngineCapability":[45,4,1,"_CPPv4N7trtorch11CompileSpec16EngineCapabilityE"],"trtorch::CompileSpec::EngineCapability::kDEFAULT":[45,5,1,"_CPPv4N7trtorch11CompileSpec16EngineCapability8kDEFAULTE"],"trtorch::CompileSpec::EngineCapability::kSAFE_DLA":[45,5,1,"_CPPv4N7trtorch11CompileSpec16EngineCapability9kSAFE_DLAE"],"trtorch::CompileSpec::EngineCapability::kSAFE_GPU":[45,5,1,"_CPPv4N7trtorch11CompileSpec16EngineCapability9kSAFE_GPUE"],"trtorch::CompileSpec::InputRange":[47,3,1,"_CPPv4N7trtorch11CompileSpec10InputRangeE"],"trtorch::CompileSpec::InputRange::InputRange":[47,1,1,"_CPPv4N7trtorch11CompileSpec10InputRange10InputRangeENSt6vectorI7int64_tEENSt6vectorI7int64_tEENSt6vectorI7int64_tEE"],"trtorch::CompileSpec::InputRange::InputRange::max":[47,2,1,"_CPPv4N7trtorch11CompileSpec10InputRange10InputRangeENSt6vectorI7int64_tEENSt6vectorI7int64_tEENSt6vectorI7int64_tEE"],"trtorch::CompileSpec::InputRange::InputRange::min":[47,2,1,"_CPPv4N7trtorch11CompileSpec10InputRange10InputRangeENSt6vectorI7int64_tEENSt6vectorI7int64_tEENSt6vectorI7int64_tEE"],"trtorch::CompileSpec::InputRange::InputRange::opt":[47,2,1,"_CPPv4N7trtorch11CompileSpec10InputRange10InputRangeENSt6vectorI7int64_tEENSt6vectorI7int64_tEENSt6vectorI7int64_tEE"],"trtorch::CompileSpec::InputRange::max":[47,6,1,"_CPPv4N7trtorch11CompileSpec10InputRange3maxE"],"trtorch::CompileSpec::InputRange::min":[47,6,1,"_CPPv4N7trtorch11CompileSpec10InputRange3minE"],"trtorch::CompileSpec::InputRange::opt":[47,6,1,"_CPPv4N7trtorch11CompileSpec10InputRange3optE"],"trtorch::CompileSpec::capability":[45,6,1,"_CPPv4N7trtorch11CompileSpec10capabilityE"],"trtorch::CompileSpec::debug":[45,6,1,"_CPPv4N7trtorch11CompileSpec5debugE"],"trtorch::CompileSpec::device":[45,6,1,"_CPPv4N7trtorch11CompileSpec6deviceE"],"trtorch::CompileSpec::disable_tf32":[45,6,1,"_CPPv4N7trtorch11CompileSpec12disable_tf32E"],"trtorch::CompileSpec::input_ranges":[45,6,1,"_CPPv4N7trtorch11CompileSpec12input_rangesE"],"trtorch::CompileSpec::kDEFAULT":[45,5,1,"_CPPv4N7trtorch11CompileSpec16EngineCapability8kDEFAULTE"],"trtorch::CompileSpec::kSAFE_DLA":[45,5,1,"_CPPv4N7trtorch11CompileSpec16EngineCapability9kSAFE_DLAE"],"trtorch::CompileSpec::kSAFE_GPU":[45,5,1,"_CPPv4N7trtorch11CompileSpec16EngineCapability9kSAFE_GPUE"],"trtorch::CompileSpec::max_batch_size":[45,6,1,"_CPPv4N7trtorch11CompileSpec14max_batch_sizeE"],"trtorch::CompileSpec::num_avg_timing_iters":[45,6,1,"_CPPv4N7trtorch11CompileSpec20num_avg_timing_itersE"],"trtorch::CompileSpec::num_min_timing_iters":[45,6,1,"_CPPv4N7trtorch11CompileSpec20num_min_timing_itersE"],"trtorch::CompileSpec::op_precision":[45,6,1,"_CPPv4N7trtorch11CompileSpec12op_precisionE"],"trtorch::CompileSpec::ptq_calibrator":[45,6,1,"_CPPv4N7trtorch11CompileSpec14ptq_calibratorE"],"trtorch::CompileSpec::refit":[45,6,1,"_CPPv4N7trtorch11CompileSpec5refitE"],"trtorch::CompileSpec::strict_types":[45,6,1,"_CPPv4N7trtorch11CompileSpec12strict_typesE"],"trtorch::CompileSpec::workspace_size":[45,6,1,"_CPPv4N7trtorch11CompileSpec14workspace_sizeE"],"trtorch::ConvertGraphToTRTEngine":[37,1,1,"_CPPv4N7trtorch23ConvertGraphToTRTEngineERKN5torch3jit6ModuleENSt6stringE11CompileSpec"],"trtorch::ConvertGraphToTRTEngine::info":[37,2,1,"_CPPv4N7trtorch23ConvertGraphToTRTEngineERKN5torch3jit6ModuleENSt6stringE11CompileSpec"],"trtorch::ConvertGraphToTRTEngine::method_name":[37,2,1,"_CPPv4N7trtorch23ConvertGraphToTRTEngineERKN5torch3jit6ModuleENSt6stringE11CompileSpec"],"trtorch::ConvertGraphToTRTEngine::module":[37,2,1,"_CPPv4N7trtorch23ConvertGraphToTRTEngineERKN5torch3jit6ModuleENSt6stringE11CompileSpec"],"trtorch::dump_build_info":[35,1,1,"_CPPv4N7trtorch15dump_build_infoEv"],"trtorch::get_build_info":[32,1,1,"_CPPv4N7trtorch14get_build_infoEv"],"trtorch::logging::Level":[17,4,1,"_CPPv4N7trtorch7logging5LevelE"],"trtorch::logging::Level::kDEBUG":[17,5,1,"_CPPv4N7trtorch7logging5Level6kDEBUGE"],"trtorch::logging::Level::kERROR":[17,5,1,"_CPPv4N7trtorch7logging5Level6kERRORE"],"trtorch::logging::Level::kGRAPH":[17,5,1,"_CPPv4N7trtorch7logging5Level6kGRAPHE"],"trtorch::logging::Level::kINFO":[17,5,1,"_CPPv4N7trtorch7logging5Level5kINFOE"],"trtorch::logging::Level::kINTERNAL_ERROR":[17,5,1,"_CPPv4N7trtorch7logging5Level15kINTERNAL_ERRORE"],"trtorch::logging::Level::kWARNING":[17,5,1,"_CPPv4N7trtorch7logging5Level8kWARNINGE"],"trtorch::logging::get_is_colored_output_on":[25,1,1,"_CPPv4N7trtorch7logging24get_is_colored_output_onEv"],"trtorch::logging::get_logging_prefix":[29,1,1,"_CPPv4N7trtorch7logging18get_logging_prefixEv"],"trtorch::logging::get_reportable_log_level":[23,1,1,"_CPPv4N7trtorch7logging24get_reportable_log_levelEv"],"trtorch::logging::kDEBUG":[17,5,1,"_CPPv4N7trtorch7logging5Level6kDEBUGE"],"trtorch::logging::kERROR":[17,5,1,"_CPPv4N7trtorch7logging5Level6kERRORE"],"trtorch::logging::kGRAPH":[17,5,1,"_CPPv4N7trtorch7logging5Level6kGRAPHE"],"trtorch::logging::kINFO":[17,5,1,"_CPPv4N7trtorch7logging5Level5kINFOE"],"trtorch::logging::kINTERNAL_ERROR":[17,5,1,"_CPPv4N7trtorch7logging5Level15kINTERNAL_ERRORE"],"trtorch::logging::kWARNING":[17,5,1,"_CPPv4N7trtorch7logging5Level8kWARNINGE"],"trtorch::logging::log":[27,1,1,"_CPPv4N7trtorch7logging3logE5LevelNSt6stringE"],"trtorch::logging::log::lvl":[27,2,1,"_CPPv4N7trtorch7logging3logE5LevelNSt6stringE"],"trtorch::logging::log::msg":[27,2,1,"_CPPv4N7trtorch7logging3logE5LevelNSt6stringE"],"trtorch::logging::set_is_colored_output_on":[26,1,1,"_CPPv4N7trtorch7logging24set_is_colored_output_onEb"],"trtorch::logging::set_is_colored_output_on::colored_output_on":[26,2,1,"_CPPv4N7trtorch7logging24set_is_colored_output_onEb"],"trtorch::logging::set_logging_prefix":[24,1,1,"_CPPv4N7trtorch7logging18set_logging_prefixENSt6stringE"],"trtorch::logging::set_logging_prefix::prefix":[24,2,1,"_CPPv4N7trtorch7logging18set_logging_prefixENSt6stringE"],"trtorch::logging::set_reportable_log_level":[28,1,1,"_CPPv4N7trtorch7logging24set_reportable_log_levelE5Level"],"trtorch::logging::set_reportable_log_level::lvl":[28,2,1,"_CPPv4N7trtorch7logging24set_reportable_log_levelE5Level"],"trtorch::ptq::Int8CacheCalibrator":[3,3,1,"_CPPv4I0EN7trtorch3ptq19Int8CacheCalibratorE"],"trtorch::ptq::Int8CacheCalibrator::Algorithm":[3,7,1,"_CPPv4I0EN7trtorch3ptq19Int8CacheCalibratorE"],"trtorch::ptq::Int8CacheCalibrator::Int8CacheCalibrator":[3,1,1,"_CPPv4N7trtorch3ptq19Int8CacheCalibrator19Int8CacheCalibratorERKNSt6stringE"],"trtorch::ptq::Int8CacheCalibrator::Int8CacheCalibrator::cache_file_path":[3,2,1,"_CPPv4N7trtorch3ptq19Int8CacheCalibrator19Int8CacheCalibratorERKNSt6stringE"],"trtorch::ptq::Int8CacheCalibrator::getBatch":[3,1,1,"_CPPv4N7trtorch3ptq19Int8CacheCalibrator8getBatchEA_PvA_PKci"],"trtorch::ptq::Int8CacheCalibrator::getBatch::bindings":[3,2,1,"_CPPv4N7trtorch3ptq19Int8CacheCalibrator8getBatchEA_PvA_PKci"],"trtorch::ptq::Int8CacheCalibrator::getBatch::names":[3,2,1,"_CPPv4N7trtorch3ptq19Int8CacheCalibrator8getBatchEA_PvA_PKci"],"trtorch::ptq::Int8CacheCalibrator::getBatch::nbBindings":[3,2,1,"_CPPv4N7trtorch3ptq19Int8CacheCalibrator8getBatchEA_PvA_PKci"],"trtorch::ptq::Int8CacheCalibrator::getBatchSize":[3,1,1,"_CPPv4NK7trtorch3ptq19Int8CacheCalibrator12getBatchSizeEv"],"trtorch::ptq::Int8CacheCalibrator::operator nvinfer1::IInt8Calibrator*":[3,1,1,"_CPPv4N7trtorch3ptq19Int8CacheCalibratorcvPN8nvinfer115IInt8CalibratorEEv"],"trtorch::ptq::Int8CacheCalibrator::readCalibrationCache":[3,1,1,"_CPPv4N7trtorch3ptq19Int8CacheCalibrator20readCalibrationCacheER6size_t"],"trtorch::ptq::Int8CacheCalibrator::readCalibrationCache::length":[3,2,1,"_CPPv4N7trtorch3ptq19Int8CacheCalibrator20readCalibrationCacheER6size_t"],"trtorch::ptq::Int8CacheCalibrator::writeCalibrationCache":[3,1,1,"_CPPv4N7trtorch3ptq19Int8CacheCalibrator21writeCalibrationCacheEPKv6size_t"],"trtorch::ptq::Int8CacheCalibrator::writeCalibrationCache::cache":[3,2,1,"_CPPv4N7trtorch3ptq19Int8CacheCalibrator21writeCalibrationCacheEPKv6size_t"],"trtorch::ptq::Int8CacheCalibrator::writeCalibrationCache::length":[3,2,1,"_CPPv4N7trtorch3ptq19Int8CacheCalibrator21writeCalibrationCacheEPKv6size_t"],"trtorch::ptq::Int8Calibrator":[4,3,1,"_CPPv4I00EN7trtorch3ptq14Int8CalibratorE"],"trtorch::ptq::Int8Calibrator::Algorithm":[4,7,1,"_CPPv4I00EN7trtorch3ptq14Int8CalibratorE"],"trtorch::ptq::Int8Calibrator::DataLoaderUniquePtr":[4,7,1,"_CPPv4I00EN7trtorch3ptq14Int8CalibratorE"],"trtorch::ptq::Int8Calibrator::Int8Calibrator":[4,1,1,"_CPPv4N7trtorch3ptq14Int8Calibrator14Int8CalibratorE19DataLoaderUniquePtrRKNSt6stringEb"],"trtorch::ptq::Int8Calibrator::Int8Calibrator::cache_file_path":[4,2,1,"_CPPv4N7trtorch3ptq14Int8Calibrator14Int8CalibratorE19DataLoaderUniquePtrRKNSt6stringEb"],"trtorch::ptq::Int8Calibrator::Int8Calibrator::dataloader":[4,2,1,"_CPPv4N7trtorch3ptq14Int8Calibrator14Int8CalibratorE19DataLoaderUniquePtrRKNSt6stringEb"],"trtorch::ptq::Int8Calibrator::Int8Calibrator::use_cache":[4,2,1,"_CPPv4N7trtorch3ptq14Int8Calibrator14Int8CalibratorE19DataLoaderUniquePtrRKNSt6stringEb"],"trtorch::ptq::Int8Calibrator::getBatch":[4,1,1,"_CPPv4N7trtorch3ptq14Int8Calibrator8getBatchEA_PvA_PKci"],"trtorch::ptq::Int8Calibrator::getBatch::bindings":[4,2,1,"_CPPv4N7trtorch3ptq14Int8Calibrator8getBatchEA_PvA_PKci"],"trtorch::ptq::Int8Calibrator::getBatch::names":[4,2,1,"_CPPv4N7trtorch3ptq14Int8Calibrator8getBatchEA_PvA_PKci"],"trtorch::ptq::Int8Calibrator::getBatch::nbBindings":[4,2,1,"_CPPv4N7trtorch3ptq14Int8Calibrator8getBatchEA_PvA_PKci"],"trtorch::ptq::Int8Calibrator::getBatchSize":[4,1,1,"_CPPv4NK7trtorch3ptq14Int8Calibrator12getBatchSizeEv"],"trtorch::ptq::Int8Calibrator::operator nvinfer1::IInt8Calibrator*":[4,1,1,"_CPPv4N7trtorch3ptq14Int8CalibratorcvPN8nvinfer115IInt8CalibratorEEv"],"trtorch::ptq::Int8Calibrator::readCalibrationCache":[4,1,1,"_CPPv4N7trtorch3ptq14Int8Calibrator20readCalibrationCacheER6size_t"],"trtorch::ptq::Int8Calibrator::readCalibrationCache::length":[4,2,1,"_CPPv4N7trtorch3ptq14Int8Calibrator20readCalibrationCacheER6size_t"],"trtorch::ptq::Int8Calibrator::writeCalibrationCache":[4,1,1,"_CPPv4N7trtorch3ptq14Int8Calibrator21writeCalibrationCacheEPKv6size_t"],"trtorch::ptq::Int8Calibrator::writeCalibrationCache::cache":[4,2,1,"_CPPv4N7trtorch3ptq14Int8Calibrator21writeCalibrationCacheEPKv6size_t"],"trtorch::ptq::Int8Calibrator::writeCalibrationCache::length":[4,2,1,"_CPPv4N7trtorch3ptq14Int8Calibrator21writeCalibrationCacheEPKv6size_t"],"trtorch::ptq::make_int8_cache_calibrator":[31,1,1,"_CPPv4I0EN7trtorch3ptq26make_int8_cache_calibratorE19Int8CacheCalibratorI9AlgorithmERKNSt6stringE"],"trtorch::ptq::make_int8_cache_calibrator::Algorithm":[31,7,1,"_CPPv4I0EN7trtorch3ptq26make_int8_cache_calibratorE19Int8CacheCalibratorI9AlgorithmERKNSt6stringE"],"trtorch::ptq::make_int8_cache_calibrator::cache_file_path":[31,2,1,"_CPPv4I0EN7trtorch3ptq26make_int8_cache_calibratorE19Int8CacheCalibratorI9AlgorithmERKNSt6stringE"],"trtorch::ptq::make_int8_calibrator":[30,1,1,"_CPPv4I00EN7trtorch3ptq20make_int8_calibratorE14Int8CalibratorI9Algorithm10DataLoaderE10DataLoaderRKNSt6stringEb"],"trtorch::ptq::make_int8_calibrator::Algorithm":[30,7,1,"_CPPv4I00EN7trtorch3ptq20make_int8_calibratorE14Int8CalibratorI9Algorithm10DataLoaderE10DataLoaderRKNSt6stringEb"],"trtorch::ptq::make_int8_calibrator::DataLoader":[30,7,1,"_CPPv4I00EN7trtorch3ptq20make_int8_calibratorE14Int8CalibratorI9Algorithm10DataLoaderE10DataLoaderRKNSt6stringEb"],"trtorch::ptq::make_int8_calibrator::cache_file_path":[30,2,1,"_CPPv4I00EN7trtorch3ptq20make_int8_calibratorE14Int8CalibratorI9Algorithm10DataLoaderE10DataLoaderRKNSt6stringEb"],"trtorch::ptq::make_int8_calibrator::dataloader":[30,2,1,"_CPPv4I00EN7trtorch3ptq20make_int8_calibratorE14Int8CalibratorI9Algorithm10DataLoaderE10DataLoaderRKNSt6stringEb"],"trtorch::ptq::make_int8_calibrator::use_cache":[30,2,1,"_CPPv4I00EN7trtorch3ptq20make_int8_calibratorE14Int8CalibratorI9Algorithm10DataLoaderE10DataLoaderRKNSt6stringEb"],"trtorch::set_device":[34,1,1,"_CPPv4N7trtorch10set_deviceEKi"],"trtorch::set_device::gpu_id":[34,2,1,"_CPPv4N7trtorch10set_deviceEKi"],STR:[5,0,1,"c.STR"],TRTORCH_API:[6,0,1,"c.TRTORCH_API"],TRTORCH_HIDDEN:[7,0,1,"c.TRTORCH_HIDDEN"],TRTORCH_MAJOR_VERSION:[8,0,1,"c.TRTORCH_MAJOR_VERSION"],TRTORCH_MINOR_VERSION:[12,0,1,"c.TRTORCH_MINOR_VERSION"],TRTORCH_PATCH_VERSION:[9,0,1,"c.TRTORCH_PATCH_VERSION"],TRTORCH_VERSION:[10,0,1,"c.TRTORCH_VERSION"],XSTR:[11,0,1,"c.XSTR"],trtorch:[64,8,0,"-"]},"trtorch.logging":{Level:[63,9,1,""],get_is_colored_output_on:[63,10,1,""],get_logging_prefix:[63,10,1,""],get_reportable_log_level:[63,10,1,""],log:[63,10,1,""],set_is_colored_output_on:[63,10,1,""],set_logging_prefix:[63,10,1,""],set_reportable_log_level:[63,10,1,""]},"trtorch.logging.Level":{Debug:[63,11,1,""],Error:[63,11,1,""],Info:[63,11,1,""],InternalError:[63,11,1,""],Warning:[63,11,1,""]},trtorch:{DeviceType:[64,9,1,""],EngineCapability:[64,9,1,""],TensorRTCompileSpec:[64,10,1,""],check_method_op_support:[64,10,1,""],compile:[64,10,1,""],convert_method_to_trt_engine:[64,10,1,""],dtype:[64,9,1,""],dump_build_info:[64,10,1,""],get_build_info:[64,10,1,""],logging:[63,8,0,"-"],set_device:[64,10,1,""]}},objnames:{"0":["c","macro","C macro"],"1":["cpp","function","C++ function"],"10":["py","function","Python function"],"11":["py","attribute","Python attribute"],"2":["cpp","functionParam","functionParam"],"3":["cpp","class","C++ class"],"4":["cpp","enum","C++ enum"],"5":["cpp","enumerator","C++ enumerator"],"6":["cpp","member","C++ member"],"7":["cpp","templateParam","templateParam"],"8":["py","module","Python module"],"9":["py","class","Python class"]},objtypes:{"0":"c:macro","1":"cpp:function","10":"py:function","11":"py:attribute","2":"cpp:functionParam","3":"cpp:class","4":"cpp:enum","5":"cpp:enumerator","6":"cpp:member","7":"cpp:templateParam","8":"py:module","9":"py:class"},terms:{"001s":51,"00f1b6db":51,"01s":51,"04s":51,"07s":51,"0c106ec84f199a0fbcf1199010166986da732f9b0907768c9ac5ea5b120772db":66,"0x7fb41dd1c618":64,"11k":51,"12a":51,"16280mib":51,"1x1":53,"24k":51,"2_20200626":66,"2c365_subsampl":51,"2mib":51,"300w":51,"300x300":53,"31c":51,"32w":51,"32x32":51,"33c":51,"33w":51,"34c":51,"34w":51,"353k":51,"35c":51,"35k":51,"35w":51,"36c":51,"37c":51,"43w":51,"442k":51,"4fef":51,"53k":51,"55k":51,"774kb":51,"818977576572eadaf62c80434a25afe44dbaa32ebda3a0919e389dcbe74f8656":66,"81k":51,"84e944ff11f8":51,"891mib":51,"9205bed204e2ae7aafd2e01cce0f21309e281e18d5bfd7172ef8541771539d41":66,"94k":51,"9ab0":51,"abstract":[57,60],"byte":64,"case":[1,2,45,46,52,53,54,57,60,66,67],"catch":[55,65],"char":[3,4,43,65],"class":[30,31,43,44,45,46,50,51,52,53,57,60,63,64,65,67],"const":[1,2,3,4,30,31,33,34,36,37,43,44,45,46,55,60,62,65,67],"default":[1,2,3,4,17,30,31,42,44,45,46,51,53,64,65,67,69,70],"enum":[1,2,41,44,45,46,50,63,67],"export":66,"final":[54,56,58,66],"float":[62,64,65,69],"function":[1,2,3,4,45,46,47,50,51,52,53,55,57,60,65,70,71],"import":[51,52,53,55,65,68,69,70],"int":[3,4,34,43,44,62,65],"long":54,"new":[1,2,3,4,33,45,46,47,51,52,57,58,60,63,65],"public":[1,2,3,4,43,44,45,46,47,67],"return":[1,2,3,4,23,25,30,31,32,33,36,37,41,42,43,44,45,46,51,52,55,56,57,58,60,63,64,65,67],"short":55,"static":[45,47,54,60,64,65],"super":[43,52,65],"throw":[55,65],"true":[1,2,4,45,46,51,52,53,55,60,62,64,65,67,70,71],"try":[51,52,58,65,70],"var":62,"void":[3,4,24,26,27,28,34,35,41,43,44],"while":67,And:65,Are:41,Bus:51,But:65,For:[51,52,53,54,65,66,68,70],IDs:53,Its:60,Not:3,One:[64,65],PRs:65,Thats:65,The:[2,45,46,51,52,53,54,55,56,57,58,60,63,66,67,69,70],Then:[66,67,70],There:[4,51,53,54,60,65,67,68],These:[54,57],Use:[45,60,64,67],Useful:61,Using:[4,51,53,61,71],Will:36,With:[51,65,67],___torch_mangle_10:65,___torch_mangle_4847:57,___torch_mangle_5:65,___torch_mangle_9:65,__and__:62,__attribute__:42,__getitem__:62,__gnuc__:42,__init__:[52,65],__is__:62,__isnot__:62,__not__:62,__or__:62,__round_to_zero_floordiv:62,__torch__:[57,65],__torch___pytorch_detection_ssd_src_model_ssd300_trt_engin:57,__torch___torchvision_models_resnet____torch_mangle_4847_resnet_trt_engin:57,__visibility__:42,__xor__:62,_all_:55,_convolut:[62,65],_jit_to_backend:70,_jit_to_tensorrt:64,_script:64,a100:[51,52],aarch64:58,abi:68,abl:[51,52,54,55,60,61,67,70],about:[53,54,57,60,64,65,69],abov:[28,53,65],abs:62,acceler:[51,52,65,71],accept:[45,47,57,60,69],access:[53,55,60,61,65,70],accord:60,accumul:[45,64],accuraci:[53,67],achiev:[51,52],aco:62,acosh:62,across:55,acthardtanh:60,activ:[65,67,71],activationtyp:60,actual:[52,55,57,60,63,65],adaptive_avg_pool2d:62,adaptiveavgpool2d:51,add:[27,54,55,60,62,63,65,66],add_:[55,62,65],add_patch:53,addactiv:60,added:[28,54],addit:[53,55,65],addlay:65,addshuffl:65,advanc:67,affin:51,after:[53,54,61,65,68,69],again:[43,53,57,60],against:[65,69],agre:[51,52,53],agx:44,ahead:65,aim:55,algorithm:[3,4,30,31,43,67],align_corn:62,all:[17,41,42,43,44,51,52,53,55,57,64,65,67,68,69],alloc:60,allow:[45,47,51,52,53,54,55,64,69],allow_gpu_fallback:[44,45,46,64,70,71],allow_tf32:62,almost:65,alpha:[53,62],alreadi:[51,54,55,65,69],also:[31,51,52,53,54,60,61,65,66,67],alwai:[3,4,26],amazonaw:51,amp:51,analog:65,analogu:60,analysi:[51,53],ani:[51,52,53,54,60,64,65,66,69],annot:[53,60,65],anoth:65,aot:[61,65],apach:[51,52,53],apex:53,api:[13,15,16,41,42,43,44,58,60,64,65,67,68,70],apidirectori:[22,48],append:[51,52,53,62],appli:67,applic:[2,31,45,46,51,52,53,55,58,65,68,69,70,71],approach:[51,52],apr:65,aquir:65,architectur:[53,61,66],archiv:66,aren:65,arg:[54,65],argc:65,argmax:51,argument:[55,57,60,65,69],argv:65,around:[57,60,65],arrai:[3,4,54],arrayref:[44,45,47],arti:51,arxiv:67,asin:62,asinh:62,aspect:69,assembl:[54,65],assign:[3,4],associ:[54,60,65],associatevalueandivalu:60,associatevalueandtensor:[60,65],assum:70,atan:62,atanh:62,aten:[55,59,60,62,65],attach:53,attribut:[55,57,65],aug:51,auto:[43,60,65,67,71],automat:[51,52,65],avail:[51,52,53,60,66,71],ave:[51,52],averag:[45,51,52,53,64,69],avg:[53,69],avg_pool1d:62,avg_pool2d:62,avg_pool3d:62,avgpool:[51,53],avoid:51,await:51,axes:51,axi:51,b_hh:62,b_ih:62,back:[55,57,58,65],back_insert:43,backbon:53,backend:[51,52,53,64,70],background:53,base:[35,48,49,51,52,53,57,63,65,66,67],bash:[53,66],basi:[51,52,53],basic:69,batch:[3,4,43,45,51,52,53,64,67,69,71],batch_norm:[60,62],batch_siz:[43,53,67],batched_data_:43,batchnorm2d:51,batchnorm:[53,55],batchtyp:43,bazel:[58,66],bazel_vers:66,bazelbuild:66,bazelisk:66,bazelvers:66,bbox:53,bdist_wheel:66,becaus:[60,65,66],becom:60,been:[54,60,65],befor:[45,53,55,58,60,61,64,65,66],begin:[43,66],beginn:65,behav:[51,53],behavior:[45,64],being:65,below:[53,60,65],benchmark:[52,62],benefit:[60,65],best:[45,47,51,52,66],best_result:53,best_results_per_input:53,best_results_per_input_trt:53,beta:62,better:[51,52,53,65,67],between:[53,60,67],bia:[51,52,55,62,65],bin:[51,66],binari:[43,67],bind:[3,4,43],bird:51,bit:[45,60,64,65],blob:59,block0:55,block1:55,block:[54,55],bn1:51,bn2:51,bn3:51,bool:[1,2,3,4,25,26,30,36,41,43,44,45,46,55,60,62,63,64,65,67],bot:53,both:[51,52,53,65,66],bottleneck:51,bound:53,box:53,branch:66,breed:51,briefli:65,bsd:[41,42,43,44],buffer:[3,4],bug:66,build:[30,31,32,45,54,56,58,60,64,65,67,69],build_fil:66,builderconfig:44,built:[58,66,69],bust:51,bzl:66,c10:[1,2,44,45,46,47,65,67],c96b:51,c_api:59,c_str:[60,65],cach:[3,4,30,31,43,51,53,65,67,69],cache_:43,cache_fil:43,cache_file_path:[3,4,30,31,43],cache_file_path_:43,cache_size_:43,calcul:[54,65],calibr:[3,4,30,31,43,45,65,67,69],calibration_cache_fil:[30,31,67],calibration_dataload:[30,67],calibration_dataset:67,call:[30,31,33,45,51,52,53,55,57,60,64,65,70],callmethod:65,can:[1,2,4,30,31,37,45,46,47,51,52,53,54,55,56,57,58,60,64,65,66,67,68,69,70],cannot:[51,52,53,55,65],cap:51,capabl:[44,45,64,69,70],captur:53,cast:[3,4,55],cat:[62,66],caught:55,caus:[60,66],cdll:65,ceil:62,ceil_mod:[51,62],cell:53,centercrop:51,cerr:65,certifi:51,cf0691493d05062fe3239cf76773bae4c5124f4b039050dbdd291c652af3ab2a:66,chain:60,chanc:60,chang:[31,51,52,55,58,67],channel:51,check:[1,2,36,45,46,53,55,60,64,65,66,68,69],check_method_op_support:64,checkmethodoperatorsupport:[21,38,44,48,49,65],checkpoint:53,checkpoint_from_distribut:53,chimpansee_amber_r_1920x1080:51,chimpanze:51,choos:[65,66],cifar10:67,cifar:67,clamp:62,classes_to_label:53,classif:[52,53,65],classifi:52,clear:43,cli:[65,69],close:65,closer:55,cloudfront:51,coco:53,cocodataset:53,code:[51,52,53,58,61,65],collect:65,color:[25,26,63],colored_output_on:[26,41,63],com:[51,52,59,65,66,67],come:[51,52],command:[51,65,66,69],comment:66,common:[51,53,54,55],common_subexpression_elimin:55,commun:65,compar:53,comparis:[1,45],comparison:[2,45,46],compat:[1,2,45,46,55,57,66],compil:[33,36,37,45,51,52,53,55,57,60,64,67,68,69,70,71],compile_set:[52,65],compile_spec:[64,67,71],compilegraph:[21,38,44,48,49,65,67],compilespec:[0,2,3,4,21,33,37,38,44,48,49,64,65,67,71],compilespecstruct:[0,48],complet:[51,52,53,65],complex:65,compli:53,complianc:[51,52,53],compliat:67,compon:[52,56,58,65,68],compos:[51,52,53,65],composit:65,comprehens:53,comput:[45,51,52,53,66,67],conclus:51,condit:[51,52,53],confid:[51,53],config:66,configur:[33,37,61,64,65,66,67],connect:[51,55,71],consid:[51,65],consol:69,consolid:65,constant:[54,55,65],constexpr:[1,2,44,45,46],construct:[1,2,3,4,45,46,47,54,55,56,58,60,65],constructor:[1,45,46,57,65],consum:[4,54,65],contain:[30,36,51,52,53,54,55,60,64,65,66,67,68],content:67,context:[54,56,57,58],continu:[51,52,53,68],contributor:65,control:[51,52,53,65],conv1:[51,52,65],conv2:[51,52,65],conv2d:[51,52,65],conv3:51,conv4_x:53,conv5_x:53,conv:65,conveni:53,convers:[51,53,55,57,64,65],conversionctx:[60,65],convert:[3,4,33,36,37,52,53,55,56,58,61,64,70],convert_method_to_trt_engin:[64,70],convertgraphtotrtengin:[21,38,44,48,49,65],convien:45,convienc:[3,4],convolut:[53,67,71],coordin:58,copi:[43,51,52,53,60],copyright:[41,42,43,44,51,52,53,65],core:[44,51,52,53,55,58,64,65,71],corpor:[41,42,43,44,51,52,53],correct:66,correspond:[51,53,60],cos:62,cosh:62,count_include_pad:62,coupl:[51,52,54,58,68],cout:65,cp36:66,cp36m:66,cp37:66,cp37m:66,cp38:66,cp39:66,cpp:[14,15,16,41,42,43,44,50,55,58,65,67],cpp_frontend:67,cppdirectori:[22,48],cppdoc:65,creat:[30,31,51,52,53,54,57,60,64,69],credit:65,csrc:[55,59],cstddef:67,ctx:[60,65],ctype:65,cu102:66,cuda:[45,51,52,53,57,64,65,66,70],cuda_runtim:[21,44],cudafloattyp:65,cudasetdevic:34,cudnn8:66,cudnn:[51,52,53],cudnn_en:62,curl:66,current:[23,60],custom:66,cxx11:68,cycler:51,d17fnq9dkz9hgj:51,data:[1,3,4,30,31,43,44,45,46,51,52,53,54,56,58,60,67],data_dir:67,dataflow:[60,65],dataload:[4,30,31,43,45,67],dataloader_:43,dataloaderopt:67,dataloaderuniqueptr:[4,43],dataset:[31,53,67],datatyp:[0,2,21,38,44,45,46,48,49,64],dateutil:51,dbg:66,dead_code_elimin:55,deal:60,debug:[17,26,44,45,60,63,64,69,70],debugg:[64,69],decid:52,decod:51,decode_result:53,deconvolut:71,dedic:55,deep:[51,52,53,60,61,67,71],deeplearn:59,deeplearningexampl:53,def:[51,52,53,65],defin:[1,2,3,4,17,23,24,25,26,27,28,29,30,31,32,33,34,35,36,37,42,45,46,47,50,51,52,65,67,69],definit:[50,60],delet:[1,2,44,45,46,55],demo:[51,53,67],demonstr:[51,52,53],denorm:53,dep:66,depend:[31,32,51,53,54,58,65,68],depickl:57,deploi:[51,52,61,65,67],deploy:[51,52,65,67,68,69,71],deprec:62,describ:[45,51,52,53,60,64,65,70],deseri:[64,65],design:[51,52,71],destroi:60,destructor:60,detail:[51,65,68],detect:[51,57],detections_batch:53,determin:55,determinist:62,develop:[51,52,61,65,66],deviat:69,devic:[0,21,34,38,44,45,48,49,51,52,64,65,69,70,71],device_typ:[44,45,46,64,70,71],deviceclass:[0,48],devicetyp:[21,38,44,45,46,48,49,64,70,71],devicetypestruct:[0,48],dict:[53,64],dictionari:[64,65,70],differ:[31,52,53,55,58,61,65],differenti:[51,52],dilat:[51,62],dim0:62,dim1:62,dim:[51,62],dim_int:62,dim_intlist:62,dimens:55,directli:[60,61,67],directori:[18,19,20,21,22,41,42,43,44,48,51,66,67],disabl:[63,66,69],disable_tf32:[44,45,64],disclos:66,disp:51,displai:69,dist:[51,66],distdir:66,distribut:[51,52,53,64,65,67,68],div:62,div_:62,divisor_overrid:62,dl_open:68,dla:[2,44,45,46,61,64,69],dla_cor:[44,45,46,64,70,71],doc:[58,59,66],docker:[51,52,53],docsrc:58,document:[41,42,43,44,48,49,58,65,67,68,70],doe:[42,43,51,53,55,60,67],doesn:65,doing:[53,54,55,65,67],domain:67,don:[52,60,67],done:[51,53,54,58],dont:41,down:[51,52,66],download:[53,66],downsampl:51,doxygen_should_skip_thi:[43,44],driver:[51,66],drop:[53,66],dtype:[51,52,53,62,64],due:[3,4,51,53],dump:[35,66,69],dump_build_info:[21,38,44,48,49,64],dure:[60,67,69],dynam:[45,47,64],each:[3,4,45,53,54,55,57,60,64,65],eager:[51,52],earlier:51,easi:[54,55,65,69],easier:[56,58,60,65,67],easiest:66,easili:[3,4],ecc:51,ecosystem:[51,52,53],edgecolor:53,edu:67,effect:[55,65,67],effici:60,either:[45,47,51,52,53,60,64,65,66,69],element:57,element_typ:43,els:[42,43,64],elu:62,emb:65,embed:[57,62,65,69,71],emit:54,empti:[52,65],emum:[17,45],enabl:[3,4,25,51,52,53,63,64],encount:66,end:[43,60,62,65],end_dim:[62,65],end_tim:[51,52,53],endif:[42,43,44],enforc:65,engin:[1,2,33,37,45,46,47,54,56,58,61,64,65,67,69,70,71],engine_converted_from_jit:65,enginecap:[44,45,64,70],enhanc:53,ensur:[31,55],enter:54,entri:[45,60,64],entropi:[30,31,67],enumer:[1,2,17,45,46],eps:[51,62],equival:[33,51,52,53,56,58,60,64,65],equivil:37,erf:62,error:[17,54,55,58,63,65,66],etc:[64,71],eval:[51,52,53,65],evalu:[53,56,57,58],evaluated_value_map:[54,60],even:65,everi:65,everyth:17,exactli:53,exampl:[51,52,53,57,58,60,65,67],except:[51,52,53],exception_elimin:55,execpt:55,execut:[51,52,53,55,56,57,58,64,65,67],execute_engin:[57,65],exeuct:57,exhaust:65,exist:[4,33,36,37,51,64,66,67],exp:62,expand:[55,62],expand_a:62,expect:[51,55,60,65],experi:[51,52],explic:43,explicit:[3,4,44,55,61,67],explicitli:[67,70],explict:43,explictli:[1,45],expon:62,express:[51,52,53],extend:[56,58,60,65],extent:[61,65],extra:[45,65],extract:65,extractor:52,f16:[65,69,71],f32:69,facecolor:53,factori:[4,30,31,67],fail:[65,71],fallback:[60,69,71],fals:[1,2,3,4,43,44,45,46,51,53,62,64,65,70],famili:[51,52,53],familyhandyman:51,fan:51,fashion:65,fbed:51,fc1:[52,65],fc2:[52,65],fc3:[52,65],feat:[52,65],featur:[51,52,53,65,67,69,70],fed:[3,4],feed:[30,31,65],feel:61,few:[51,52],field:[3,4,67],fig:[51,53],file:[1,2,3,4,5,6,7,8,9,10,11,12,17,23,24,25,26,27,28,29,30,31,32,33,34,35,36,37,45,46,47,51,52,53,57,58,64,65,66,67,69],file_path:69,filer_publ:51,filer_public_thumbnail:51,fill:[51,52],filter:53,find:[4,53,65],finish:53,first:[51,52,53,54,55,65,67],five:53,fix:[45,51,53,71],fixed_s:[44,45],flag:[66,69],flatten:[52,62,65],flatten_convert:65,flexibl:[51,52,53],float16:[64,69],float32:[45,51,64,69],float_int:62,floor:62,floor_divid:62,floordiv:62,flow:[51,52,53,60,65],fly:65,follow:[51,52,53,65,66,67,69],footprint:[51,52],forc:[64,69],form:54,format:[45,51,52,53,64,69],forum:66,forward:[30,31,33,52,57,60,64,65,67,70],found:[41,42,43,44,51,53,65,66,67],fp16:[1,45,52,53,61,64,65,71],fp32:[1,45,52,53,61,64,67],framework:[51,52,53],freed:60,freez:65,freeze_modul:55,from:[1,2,3,4,30,31,43,45,46,47,51,52,53,54,55,56,57,58,60,61,65,67,69],fssl:66,fstream:[20,43],full:[60,65,67,68,69,71],fulli:[36,55,64,65,67,71],fuse:[51,52],fuse_addmm_branch:55,fuse_flatten_linear:55,fuse_linear:55,fusion:60,futur:[51,52],gain:53,gamma:62,gaurd:42,gcc:[58,65],gear:67,gener:[3,4,31,51,52,53,55,57,58,60,65,67,69],get:[1,2,3,4,23,32,43,45,46,47,53,55,60,63,66,67,70],get_batch_impl:43,get_build_info:[21,38,44,48,49,64],get_coco_object_dictionari:53,get_is_colored_output_on:[18,39,41,48,49,63],get_logging_prefix:[18,39,41,48,49,63],get_reportable_log_level:[18,39,41,48,49,63],getattr:[55,57,65],getbatch:[3,4,43],getbatchs:[3,4,43],getdimens:[60,65],getoutput:[60,65],github:[51,52,53,59,65,66,67],give:52,given:[45,51,53,55,64,65,69,70],global:[27,65],gnu:66,goal:60,going:[43,65],good:[43,60],got:65,govern:[51,52,53],gpu:[2,33,34,37,44,45,46,51,52,64,65,69,70,71],gpu_id:[34,44,45,46,64,70,71],granular:52,graph:[17,33,36,37,44,51,52,53,54,56,58,60,61,64,65],great:[51,52,53,65],green_mamba:51,group:62,gtc:61,guard:55,guard_elimin:55,gulf:51,hack:43,hakaimagazin:51,half:[52,53,64,65,69,70,71],handl:[53,55,57],happen:[51,52,65],hardtanh:[60,62],hardtanh_:62,hardwar:[51,52,53,71],has:[51,52,53,54,55,58,60,65,67],hash:66,have:[31,43,51,52,53,54,55,60,61,65,66,67,69],haven:65,head:53,header:[51,65],help:[26,51,52,54,60,65,69],helper:[51,52,53,60],here:[43,51,52,53,54,57,65,66,67],hermet:66,hfile:[22,48],hidden:42,high:[51,53,55,65],higher:[55,65],hinton:67,hold:[45,46,47,54,60,67],holder:57,home:66,hood:58,host:66,how:[3,4,51,53,65,70],howev:[31,51,52,53,66],html:[59,65,66,67],http:[51,52,53,59,65,66,67],http_archiv:66,hub:[51,53],huski:51,idea:55,ident:69,idx:[53,62],ifndef:[43,44],ifstream:43,iint8calibr:[3,4,30,31,43,44,45,67],iint8entropycalibrator2:[3,4,30,31,43,67],iint8minmaxcalibr:[30,31,67],ilay:60,imag:[51,53,67],image_idx:53,imagenet:51,imagenet_cla:51,imagenet_class_index:51,images_:67,img0:51,img1:51,img2:51,img3:51,img:51,img_path:51,impact:[51,52,53],implement:[3,4,51,52,53,55,57,65,67],impli:[51,52,53],implic:55,implicit:62,imshow:[51,53],in_featur:[51,52],in_shap:65,in_tensor:65,incas:43,includ:[14,16,17,32,35,41,42,43,44,50,51,52,53,64,65,66,67,69],includedirectori:[22,48],ind:51,independ:[51,53],index:[59,61,62,67],indic:62,inetworkdefinit:54,infer:[51,52,55,65,67],info:[17,33,37,44,45,60,63,65,69],inform:[28,32,35,53,54,61,64,65,67,69,70],infrastructur:67,ingest:58,inherit:[48,49,67],inlin:[43,55,65],inner:45,inplac:51,input0:65,input1:65,input2:65,input:[3,4,31,43,45,47,51,52,53,54,55,57,60,62,64,65,67,69,70,71],input_0:[57,65],input_batch:51,input_data:[51,52,53,65],input_file_path:[69,71],input_rang:[44,45],input_s:65,input_scal:62,input_shap:[51,52,53,64,65,67,69,70,71],input_tensor:51,inputrang:[21,38,44,45,48,49,65],inputrangeclass:[0,48],inspect:[52,60,65],instal:[51,53,61,65,68],instanc:[51,52,55,65],instanti:[56,57,58,60,65],instatin:[1,2,45,46],instead:[54,55,65,68,69],instnanti:57,instruct:[65,66],insur:66,int16_t:44,int64_t:[44,45,46,47,67,71],int8:[1,43,45,61,64,67,69,71],int8_t:44,int8cachecalibr:[20,31,40,43,48,49],int8cachecalibratortempl:[0,48],int8calibr:[3,20,30,40,43,48,49],int8calibratorstruct:[0,48],int_float:62,integ:64,integr:[51,52,61],intent:55,intercompat:[51,53],interest:55,interfac:[1,2,45,46,57,58,60,65,67],intermedi:[17,51,52,65],intern:[2,17,45,46,51,52,53,60,65],internal_error:63,internalerror:63,interpret:[51,52,57],intro_to_torchscript_tutori:65,introduc:[51,52,53],invok:65,involv:[51,52],ios:43,iostream:[20,43,65],is_avail:51,is_train:67,iscustomclass:60,issu:[3,4,51,52,65,66],istensor:60,istream_iter:43,it_:43,item:51,itensor:[54,60,65],iter:[20,43,45,51,52,53,54,64,69],its:[31,51,52,53,54,57,60],itself:[1,2,45,46,55,66,69,70],ivalu:[54,57,60,65],jetson:[51,52,64],jit:[33,36,37,44,51,52,53,54,55,56,57,58,59,60,64,65,69,70],jpeg:51,jpg:[51,53],jpg__1920x1080_q85_subject_loc:51,json:51,json_fil:51,just:[43,44,51,53,55,61,65,68,70],kchar:[1,44,45],kclip:60,kcpu:[2,45,46],kcuda:[2,45,46,65],kdebug:[17,41,43],kdefault:[44,45],kdla:[2,44,45,46,71],keepdim:62,kei:[64,65],kernel:[45,51,52,60,64,65,69],kernel_s:[51,52,62],kerror:[17,41],kf16:71,kfloat:[1,44,45],kgpu:[2,44,45,46],kgraph:[17,41,55],khalf:[1,44,45,65],ki8:67,kind:[51,52,53,54,64],kinfo:[17,41,43],kinternal_error:[17,41],kiwisolv:51,know:[41,60],known:53,kriz:67,krizhevski:67,ksafe_dla:[44,45],ksafe_gpu:[44,45],ktest:67,ktrain:67,kwarn:[17,41],label:[53,67],laid:65,lambda:[60,65],languag:[51,52,53,65],larg:[51,52,56,58,65,67],larger:67,largest:62,last:[53,55],later:[31,65],latest:66,law:[51,52,53],layer1:51,layer2:51,layer3:51,layer4:51,layer:[45,46,51,52,53,54,55,60,64,65,67,69,71],ld_library_path:66,ld_preload:68,ldd:66,leaky_relu:62,leaky_relu_:62,learn:[61,65,66,67,71],least:51,leav:[52,55],left:53,len:[51,53,62],lenet:[53,65],lenet_script:65,lenetclassifi:[52,65],lenetfeatextractor:[52,65],length:[3,4,43,51,62],let:[45,46,51,52,53,55,60,69],level:[18,23,27,28,39,41,43,48,49,51,52,55,58,63,65],levelnamespac:[0,48],leverag:[51,52,53,67],lib:[51,55,65,66],librari:[32,41,42,43,44,51,52,53,56,57,58,60,65],libtorch:[4,35,51,52,53,60,65,66,67],libtorch_pre_cxx11_abi:66,libtrtorch:[65,66,69],libtrtorchrt:68,licens:[41,42,43,44,51,52,53,65],like:[51,52,53,54,55,57,60,65,66,67,68,69],limit:[51,52,53,55,67],line:[65,69],linear:[51,52,62,65],linewidth:53,link:[54,61,65,68,69],linux:[58,65,66],linux_x86_64:66,list:[18,19,20,21,36,50,53,54,57,60,62,64,65,66],listconstruct:[54,57,65],listunpack:[57,65],live:60,load:[51,53,57,65,66,67,68,69,70],load_librari:68,loader:[51,52,53],local:[51,53,55,65],locat:[53,67],log:[16,17,19,20,22,38,43,48,49,50,55,60,62,64],log_debug:60,logger:63,loggingenum:[0,48],loglevel:63,longer:[51,52,68],look:[54,55,65,67,70],loop_unrol:55,lorikeet:51,loss:67,lot:60,lower:17,lower_graph:55,lower_tupl:55,loweralltupl:55,lowersimpletupl:55,lstm_cell:62,lvl:[27,28,41],machin:[51,52,57,66,67],macro:[5,6,7,8,9,10,11,12,16,18,21,22,41,44,48,50],made:[53,55,56,58],mai:[51,52,53,54,57,58,65,67],main:[53,55,56,57,58,60,65],maintain:[57,60],major:[51,52,53,58],make:[51,52,53,54,65,66,67,71],make_data_load:[4,67],make_int8_cache_calibr:[20,40,43,48,49,67],make_int8_calibr:[20,31,40,43,48,49,67],manag:[54,56,58,60,65],mangag:55,mantissa:[45,64],manual:66,map:[2,45,46,54,55,56,58,60,65,67,70],master:[59,66,67],match:[45,55,66],matmul:[55,62,65],matplotlib:[51,53],matrix:59,matur:58,max:[44,45,47,52,60,62,64,65,69],max_batch_s:[44,45,64,69,70],max_c:69,max_h:69,max_n:69,max_pool1d:62,max_pool2d:[52,62,65],max_pool3d:62,max_val:[60,62],max_w:69,maximum:[45,47,64,65,69],maxpool2d:51,maxpool:51,mean:[45,51,52,53,60,61,62,64,65,69],mechan:60,media:51,meet:64,member:[45,46,47,64],memori:[20,21,43,44,51,52,55,60,65],mention:51,menu:69,messag:[17,27,28,63,69],metadata:[57,60],method:[33,36,37,51,52,53,55,60,64,65,66,70],method_nam:[36,37,44,64,65],mig:51,might:55,min:[44,45,47,52,60,62,64,65,69],min_c:69,min_h:69,min_n:69,min_val:[60,62],min_w:69,mini:51,minim:[45,64,67,69],minimum:[45,47,63,65],minmax:[30,31,67],miss:65,mix:53,mkdir:[51,66],mobilenet_v2:70,mod:[65,67],mode:[65,67],mode_:67,model:[57,65,67,70],model_math:53,modern:53,modifi:66,modul:[33,36,37,44,51,52,53,56,57,58,60,61,64,67,69,70,71],modular:65,momentum:[51,62],more:[51,52,53,54,61,65,67,68,70],most:58,move:[30,43,44,51,52,55,57,65,67],msg:[27,41,63],much:[60,67],mul:62,mul_:62,multipl:[57,67],multipli:[45,64],must:[45,51,53,60,64,65,66,68,69],n01749939:51,n01820546:51,n02110185:51,n02481823:51,name:[3,4,36,37,43,51,53,57,60,64,65,66,70],namespac:[0,41,43,44,50,55,61,67],nano:66,narrow:62,nativ:[58,59,65],native_funct:59,nbbind:[3,4,43],ncol:51,necessari:[41,68],need:[1,2,28,31,42,45,46,53,54,55,60,65,66,67,68],neg:62,negative_slop:62,nest:[48,49],net:[51,60,65],network:[30,31,51,52,53,60,65,67,71],neural:[51,53,71],new_lay:60,new_local_repositori:66,new_siz:67,newer:[51,52],next:[3,4,53,54,57,67],ngc:53,nice:66,ninja:66,nlp:[30,31,67],no_grad:[51,52,53],node:[55,60,65],node_info:[60,65],noexcept:67,none:[53,60,62],normal:[1,2,45,46,51,52,53,65,67,71],noskipw:43,note:[2,45,46,51,60,65,66,71],notebook:[51,52,53,58],notic:[52,53],now:[51,52,53,55,58,60,65,66,70],nrow:51,nrun:[51,52,53],nullptr:[43,44,45],num:69,num_avg_timing_it:[44,45,64,70],num_it:69,num_min_timing_it:[44,45,64,70],number:[3,4,45,51,55,60,64,65,69],numel:62,numer:69,numpi:[51,52,53],nvidia:[33,37,41,42,43,44,51,52,53,59,64,65,66,67,69,71],nvidia_deeplearningexamples_torchhub:53,nvidia_ncf:53,nvidia_ssd:53,nvidia_ssd_processing_util:53,nvidia_tacotron2:53,nvidia_waveglow:53,nvinfer1:[3,4,30,31,43,44,45,60,67],nvinfer:[20,43],nwarmup:[51,52,53],obj:62,object:[1,2,3,4,45,46,47,60,64,65,70],observ:51,obsolet:53,obtain:[51,52,53],obvious:65,octet:51,off:[51,53,57],offici:66,ofstream:[43,65],older:58,olefil:51,onc:[41,42,43,44,54,55,57,65,67,68],one:[53,55,60,63,65],ones:[41,51,52,53,65,66],onli:[2,3,4,17,31,43,45,46,52,53,55,58,60,63,64,65,66,67,68,69,71],onnx:55,onto:[57,69],op_precis:[44,45,51,52,53,64,65,67,69,70,71],open:[51,52],oper:[1,2,3,4,36,43,44,45,46,51,52,54,55,56,57,58,60,61,64,67,69,71],ops:[51,53,55,65,68],opset:[56,58],opt:[44,45,47,52,64,65,66],opt_c:69,opt_h:69,opt_n:69,opt_w:69,optim:[45,47,51,52,53,55,61,65,69],optimi:65,optimin:[45,47],optimiz:[51,52,53],option:[43,64,66,67,68,69,71],order:[45,53,60,65],org:[51,52,53,59,65,66,67],origin:53,original_nam:52,other:[1,2,44,45,46,51,52,53,54,55,57,61,62,64,65,66,68,69],otherwis:[66,68],our:[51,52,53,58,65],out:[36,43,51,52,54,55,56,58,60,63,64,65,66],out_featur:[51,52],out_shap:65,out_tensor:[60,65],output0:55,output:[25,26,45,51,52,53,54,55,57,60,63,65,66,69],output_file_path:[69,71],output_pad:62,output_s:[51,62],outself:65,over:[51,52,56,58],overkil:52,overrid:[3,4,30,31,43,67],overview:[59,61],own:[51,52,60,65],p100:51,packag:[51,55,65,69],pad:[51,62],padding_idx:62,page:61,pair:[60,67],paper:[51,53],paramet:[1,2,3,4,26,27,28,30,31,33,34,36,37,45,46,47,54,55,60,63,64,65],parent:[14,15,16,18,19,20,21],pars:65,part:[58,69],particular:52,pass:[54,56,57,58,60,65,67],patch:53,path:[4,13,14,15,16,30,31,51,52,53,65,66,67,69],path_to_trtorch_root:66,pathwai:65,pattern:[60,65],peephole_optimz:55,per:53,perf:51,perform:[30,31,51,52,53],performac:[45,47,67],permiss:[51,52,53],permut:62,persist:51,phase:[17,60,65],pick:[52,65],pick_best:53,pickler:57,pid:51,pil:51,pillow:[51,53],pip3:66,pip3_import:66,pip:[51,53,66],pip_instal:66,pipelin:[65,69,71],piplein:65,place:[55,66,67],plan:[58,69],platform:[44,51,52,58,66,71],pleas:66,plot:53,plot_result:53,plt:[51,53],point:[64,65],pointer:[3,4,67],pool:71,pop:57,portabl:[51,52,53,57],posit:69,possibl:[51,52],post:[30,31,45,61,65,69],pow:62,power:[51,52,65],practic:[51,52],pragma:[41,42,43,44,67],pre:[51,68],pre_cxx11_abi:66,precis:[45,52,53,61,64,65,67,69,71],pred:51,pred_label:53,pred_loc:53,predict:[51,53],prefer:65,prefix:[24,26,41,63],prelu:62,prepar:[51,52,53],prepare_input:53,prepare_tensor:53,preprint:67,preprocess:[51,67],preserv:[65,67],prespect:65,pretrain:[51,53,70],pretti:65,prevent:45,previous:[31,65],prim:[54,55,57,62,65],primarili:[58,65],primer:53,print:[17,36,43,51,52,53,63,64,65,70],priorit:66,privat:[3,4,43,44,67],prob:51,probabl:[51,53],probablil:51,process:[51,52,53,65,69,70],prod:62,produc:[45,47,54,57,60,65],product:[45,51,52],profil:[45,47],program:[18,19,20,21,31,50,51,52,53,56,58,61,65,69],propog:55,provid:[3,4,45,57,60,64,65,66,67,70],providi:[56,58],ptq:[3,4,16,18,22,38,48,49,50,61,69],ptq_calibr:[3,4,44,45,67],ptqtemplat:[0,48],pull:66,pure:36,purpos:[51,53,66],push:57,push_back:43,pwr:51,py_test_dep:66,pypars:51,pyplot:[51,53],python3:[51,55,65,66],python:[51,52,53,58,68,69,71],python_api:59,pytorch:[51,53,56,57,58,60,64,65,66,67,68],pytorch_vision_v0:51,qualiti:[51,53],quantiz:[30,31,61,65,69],quantizatiom:45,question:65,quickli:[65,67,69],quit:[60,65],rais:55,raiseexcept:55,rand:65,randn:[51,52,53,65,70],rang:[45,47,51,52,53,64,65,69],rather:55,raw:53,read:[3,4,30,31,43,67],readcalibrationcach:[3,4,43],readm:[51,52,53],realiz:57,realli:60,reason:[1,45,53,65],recalibr:31,recipi:53,reciproc:62,recognit:[51,67],recomend:[30,31],recommend:[30,31,65,66],recompil:53,record:[51,52,54,65],rect:53,rectangl:53,recurs:54,recursivescriptmodul:52,reduc:[51,52,55,56,58,67],refer:[56,58],referenc:[53,66],refit:[44,45,64,70],reflect:44,regard:66,regist:[57,60],registernodeconversionpattern:[60,65],registri:[54,65],reinterpret_cast:43,relat:[45,46],relationship:[48,49],relu:[51,52,62,65],relu_:62,remain:[51,52,53,55,67],remov:[51,53],remove_contigu:55,remove_dropout:55,remove_to:55,repack:57,repeat:62,replac:[53,55],report:[23,43],reportable_log_level:63,repositori:[51,53,58],repres:[45,47,60,63],represent:[51,52,55,60,65],request:[51,65],requir:[31,51,52,53,54,55,63,64,65,66,67,68,69],research:[51,52],reserv:[41,42,43,44,51,52,53],reset:43,reshap:62,residu:51,resiz:51,resnet50:51,resnet50_model:51,resnet:[53,57],resnet_50_trac:51,resnet_trt:57,resolv:[51,54,55,56,58],resourc:[54,67],respons:[31,51,57],restrict:[45,64,69],result:[51,52,54,55,64,65],results_per_input:53,ret:55,reus:[55,67],rgb:51,right:[41,42,43,44,51,52,53,55,58,60],rn50_preprocess:51,root:[41,42,43,44,51,53,66,67],round:[45,64],rsub:62,rule:66,run:[2,37,45,46,51,52,53,54,55,56,57,58,60,61,64,65,66,67,68,69,70,71],runtim:[51,52,53,61,65],safe:[60,64],safe_dla:[64,69],safe_gpu:[64,69],safeti:[45,64],same:[51,53,57,65,66,70],sampl:[51,67],satisfi:51,save:[31,43,51,52,53,57,64,68,69],saw:65,scalar:[60,62],scalartyp:[1,44,45],scale:[62,67],scale_factor:62,scale_grad_by_freq:62,scales_d:62,scales_h:62,scales_w:62,schema:[60,65],scikit:53,scipi:53,scope:55,score:[51,53],scratch:31,script:[36,51,53,55,64,65,70],script_model:[52,65,70],scriptclass:64,scripted_model:71,scriptmodul:[64,65],sdk:[51,52,53,59],seamlessli:61,search:61,section:67,secur:66,see:[36,51,52,53,55,57,64,65],select:[30,31,37,45,51,52,62,64,67,69],self:[52,55,57,60,62,65,71],self_1:[57,65],self_int:62,sens:65,sent:51,separ:[51,52,53],sequenti:51,serial:[37,56,58,64,65],serializ:57,seril:57,serv:[57,69],set:[3,4,17,26,28,31,33,34,37,44,45,46,47,51,52,53,54,55,56,57,58,61,63,64,65,66,67,69,71],set_devic:[21,38,44,48,49,64],set_is_colored_output_on:[18,39,41,48,49,63],set_logging_prefix:[18,39,41,48,49,63],set_reportable_log_level:[18,39,41,48,49,63],setalpha:60,setbeta:60,setnam:[60,65],setreshapedimens:65,setup:67,sever:[17,27,63],sha256:66,shape:[45,47,51,52,53,60,62,64,71],share:66,ship:[65,68],should:[1,3,4,31,44,45,51,54,60,61,63,64,67,69],show:[51,53],shown:65,shuffl:65,shutterstock_780480850:51,siberian:51,siberian_huski:51,side:[55,65],sigmoid:62,sigmoid_:62,signifi:[45,47],signific:53,significantli:55,similar:[53,60,65,70],simonyan:67,simpil:67,simpl:[52,65],simpli:[52,55],simplic:[51,53],simplifi:54,sin:62,sinc:[52,55,65,67],singl:[45,47,52,55,65,67,69],singular:60,sinh:62,site:[55,65,66],six:51,size:[3,4,43,45,47,51,52,53,55,62,64,65,67,69,71],size_t:[3,4,43,67],slice:62,slither:51,sm_output:51,small:55,smi:51,snake:51,softmax:[51,53,55,62],softwar:[51,52,53],sole:67,some:[54,55,56,57,58,60,65,67],someth:[42,55],sort:[60,62,70],sourc:[41,42,43,44,51,53,58,64],space:67,spars:62,spec:[64,70],specif:[33,51,52,53,55,56,58,64],specifi:[3,4,51,53,60,61,63,64,65,69,70],specifii:64,speed:[51,53],speedup:51,split:62,split_siz:62,split_with_s:62,sqrt:62,squeez:62,src:[57,59],ssd300:53,ssd300_trt:57,ssd:57,ssd_300_trace:53,ssd_trace:69,ssd_trt:69,sstream:[20,43],stabl:59,stack:[57,62,67],stage:54,stand:57,standard:[51,52,53,61,68,69,70],start:[53,54,62,66,70],start_dim:[62,65],start_tim:[51,52,53],state:[54,60,65],statement:55,static_cast:43,statu:43,std:[3,4,24,27,29,30,31,32,36,37,41,43,44,45,47,51,65,67,71],stdout:[35,63,64],steamlin:67,step:[51,52,53,61,62,67],still:[43,51,53,67],stitch:[52,65],stop:65,storag:67,store:[4,54,57,60,65],str:[19,42,43,48,49,51,63,64],straight:60,stream:51,strict:[68,69],strict_typ:[44,45,64,70],strictli:64,stride:[51,52,53,62],string:[3,4,18,20,21,24,27,29,30,31,32,36,37,41,43,44,60,64,65,67],stringstream:43,strip_prefix:66,strong:[51,52],struct:[1,2,21,38,44,67],structur:[31,44,45,46,51,52,58,60,65],style:[41,42,43,44],sub:[62,65],sub_:62,subdirectori:50,subexpress:55,subgraph:[54,55,60,65],subject:58,submodul:[52,65],subplot:[51,53],subset:67,successfulli:[51,53],sudo:66,suffic:55,suggest:53,suit:61,sum:[45,62,64],support:[1,2,26,36,45,46,47,51,52,53,59,61,64,65,66,69,71],sure:[65,66,71],sxm2:51,symbol:66,synchron:[51,52,53],system:[51,53,54,60,61,66],take:[33,36,37,51,52,53,54,56,57,58,60,64,65,67,70],taken:[51,53],talk:61,tan:62,tanh:62,tanh_:62,tar:[66,67],tarbal:[65,67],target:[2,44,45,46,51,52,53,58,61,64,65,67,69,70,71],targets_:67,task:[30,31,67],techinqu:65,techniqu:67,tell:60,temp:51,templat:[20,40,43,44,48,49,65],tensor:[43,45,47,51,52,53,54,55,57,60,62,65,67],tensor_scalar:62,tensor_tensor:62,tensorcontain:60,tensorlist:60,tensorrt:[1,2,3,4,30,31,33,35,37,44,45,46,47,51,52,53,54,55,56,58,60,61,64,65,67,69,70],tensorrtcompilespec:[64,70],term:67,termin:[26,65,69],tesla:51,test:[51,52,53,58,66,69],text:[53,63],tf32:45,tgz:66,than:[55,61,66,68],thats:[54,67],thei:[45,46,53,54,55,60,66,69],them:[51,52,53,57,65,66],theori:54,therebi:57,therefor:[31,65],therfor:68,thi:[1,2,30,31,41,42,43,44,45,46,47,51,52,53,54,55,56,57,58,60,65,66,67,68,69,70],thing:52,think:60,third_parti:[58,66],those:54,though:[51,53,58,60,65,69],three:[45,47,56,58],threshold:69,thrid_parti:66,through:[51,52,53,54,55,57,61,65],time:[45,51,52,53,54,55,56,58,60,64,65,67,69],tini:67,titan:[51,52],titl:51,tmp:65,tocustomclass:60,todim:65,togeth:[52,54,60,65],toilet:51,too:66,tool:[51,52,60,65],toolchain:58,top:[53,58],topk:62,torch:[1,2,4,20,30,31,33,36,37,43,44,45,46,51,52,53,55,57,59,60,64,65,66,67,68,69,70,71],torch_scirpt_modul:65,torch_script_modul:65,torchbind:57,torchhub:53,torchscript:[33,36,37,51,53,56,57,58,64,69,70,71],torchvis:[51,57,70],toronto:67,totensor:51,tovec:65,toward:67,trace:[53,64,65],traced_model:[51,52,53,65],track:[60,67],track_running_stat:51,trade:53,tradit:[64,67],traget:33,train:[30,31,45,51,53,61,62,65,69],trainabl:55,transform:[51,52,65,67],translat:[53,65],transpos:62,travers:[56,58],treat:69,tree:[41,42,43,44,67],trigger:[52,65],trim:67,trt:[1,2,3,4,45,46,54,55,57,60,62,65],trt_lenet_script:65,trt_mod:[65,67,71],trt_model:[51,53,70],trt_model_fp32:51,trt_script_modul:52,trt_ts_modul:[52,65],trtorch:[0,1,2,3,4,15,17,22,41,42,43,45,46,47,49,50,54,55,56,57,58,66,67,69,71],trtorch_api:[19,23,24,25,26,27,28,29,30,31,32,33,34,35,36,37,41,42,43,44,48,49],trtorch_check:60,trtorch_hidden:[19,42,48,49],trtorch_major_vers:[19,42,48,49],trtorch_minor_vers:[19,42,48,49],trtorch_patch_vers:[19,42,48,49],trtorch_py_dep:66,trtorch_unus:60,trtorch_vers:[19,42,48,49],trtorchc:[61,71],trtorchfil:[22,48],trtorchnamespac:[0,48],ts_model:65,tue:51,tune:[51,52,53],tupl:[57,64,65],tupleconstruct:[55,57],tupleunpack:55,tutori:[65,67],two:[51,52,53,60,65,66,67,69],txt:66,type:[1,2,30,47,48,49,51,54,57,60,63,64,65,67,69],typenam:[3,4,30,31,43],typic:[54,60],ubuntu:66,uint64_t:[44,45],unabl:[60,65],uncom:66,uncorr:51,under:[41,42,43,44,51,52,53,58],underli:[1,2,45,46,60],understand:65,union:[60,65],uniqu:4,unique_ptr:[4,30],unit:52,unless:[51,52,53],unlik:[61,65,66,70],unpack_addmm:55,unpack_log_softmax:55,unqiue_ptr:4,unsqueez:[51,62],unstabl:58,unsupport:[36,64],unsur:60,untest:58,until:[54,58,60,66],unwrap:60,unwrap_distribut:53,unwraptodoubl:60,unwraptoint:65,unzip:66,upgrad:51,upload:51,upsample_bilinear2d:62,upsample_linear1d:62,upsample_nearest1d:62,upsample_nearest2d:62,upsample_nearest3d:62,upsample_trilinear3d:62,upstream:65,uri:53,url:66,usag:[51,65],use:[1,2,3,4,30,31,45,46,51,52,53,54,55,57,58,60,63,64,65,66,67,68,69,70],use_cach:[3,4,30,43],use_cache_:43,use_subset:67,usecas:66,used:[1,2,3,4,43,45,46,47,51,53,54,55,57,60,63,64,65,67,69],useful:60,user:[41,51,52,56,57,58,65,66,67],uses:[30,31,43,51,52,53,60,66,67],using:[1,2,33,34,37,43,44,45,46,51,52,53,60,61,64,65,67,68,69,70],using_int:[62,65],usr:[51,66],usual:53,util:[60,64,65],val2017:53,val:53,valid:[2,45,46,53,60],valu:[1,2,17,44,45,46,54,57,60,62,63,65],value_tensor_map:[54,60],variant:68,varient:55,variou:71,vec:62,vector:[20,21,43,44,45,47,65,67,71],verbios:69,verbos:69,veri:[67,70],version:[32,35,51,52,53,58,66],vgg16:67,vgg:53,via:[51,53,61,64,68],view:62,virtual:67,vision:51,visit:53,volatil:51,volta:[51,52],w_hh:62,w_ih:62,wai:[51,65,66,69],walk:[51,52,53],want:[41,45,51,52,65,70],warm:[51,52,53],warn:[17,43,51,60,63,69],warranti:[51,52,53],websit:66,weight:[54,62,65],welcom:65,well:[51,52,53,65,67],were:[53,65],wget:51,what:[4,53,55,65],whatev:57,when:[26,43,44,45,46,51,52,54,55,56,57,58,60,63,64,65,66,67,69],where:[51,52,54,55,60,65,67],whether:[4,67],which:[2,31,33,37,45,46,51,52,53,54,55,56,57,58,60,64,65,67,70],whilst:53,white:53,whl:66,whole:[51,52],whose:55,width:51,within:[51,52,53,56,58],without:[51,52,53,60,65,67],work:[43,52,53,55,58,60,67],worker:67,workflow:70,workspac:[45,64,66,67,69,71],workspace_s:[44,45,51,53,64,67,69,71],world:[51,52],would:[60,65,66,68,69,70],wrap:[56,57,58,65,70],wrapper:60,write:[3,4,30,31,43,51,52,53,54,61,65,67],writecalibrationcach:[3,4,43],www:[51,52,53,65,66,67],x64:66,x86:68,x86_64:[58,66],xavier:[44,51,52,64,71],xstr:[19,42,48,49],yaml:59,you:[1,2,30,31,45,46,51,52,53,54,55,57,58,60,61,64,65,66,67,68,69,70],your:[51,52,53,60,61,65,66,68,70],yourself:65,zip:[57,66],zisserman:67},titles:["Class Hierarchy","Class CompileSpec::DataType","Class Device::DeviceType","Template Class Int8CacheCalibrator","Template Class Int8Calibrator","Define STR","Define TRTORCH_API","Define TRTORCH_HIDDEN","Define TRTORCH_MAJOR_VERSION","Define TRTORCH_PATCH_VERSION","Define TRTORCH_VERSION","Define XSTR","Define TRTORCH_MINOR_VERSION","Directory cpp","Directory api","Directory include","Directory trtorch","Enum Level","File logging.h","File macros.h","File ptq.h","File trtorch.h","File Hierarchy","Function trtorch::logging::get_reportable_log_level","Function trtorch::logging::set_logging_prefix","Function trtorch::logging::get_is_colored_output_on","Function trtorch::logging::set_is_colored_output_on","Function trtorch::logging::log","Function trtorch::logging::set_reportable_log_level","Function trtorch::logging::get_logging_prefix","Template Function trtorch::ptq::make_int8_calibrator","Template Function trtorch::ptq::make_int8_cache_calibrator","Function trtorch::get_build_info","Function trtorch::CompileGraph","Function trtorch::set_device","Function trtorch::dump_build_info","Function trtorch::CheckMethodOperatorSupport","Function trtorch::ConvertGraphToTRTEngine","Namespace trtorch","Namespace trtorch::logging","Namespace trtorch::ptq","Program Listing for File logging.h","Program Listing for File macros.h","Program Listing for File ptq.h","Program Listing for File trtorch.h","Struct CompileSpec","Struct CompileSpec::Device","Struct CompileSpec::InputRange","TRTorch C++ API","Full API","Full API","TRTorch Getting Started - ResNet 50","TRTorch Getting Started - LeNet","Object Detection with TRTorch (SSD)","Conversion Phase","Lowering Phase","Compiler Phases","Runtime Phase","System Overview","Useful Links for TRTorch Development","Writing Converters","TRTorch","Operators Supported","trtorch.logging","trtorch","Getting Started","Installation","Post Training Quantization (PTQ)","Deploying TRTorch Programs","trtorchc","Using TRTorch Directly From PyTorch","DLA"],titleterms:{"class":[0,1,2,3,4,20,21,38,40,48,49],"enum":[17,18,39,48,49,64],"function":[18,20,21,23,24,25,26,27,28,29,30,31,32,33,34,35,36,37,38,39,40,48,49,59,64],The:65,Used:55,Useful:59,Using:[65,70],aarch64:66,abi:66,addmm:55,advic:60,ahead:61,api:[14,18,19,20,21,48,49,50,59,61,66],applic:67,arg:60,avail:59,background:[57,60,65],base:[3,4],benchmark:[51,53],binari:66,branch:55,build:66,checkmethodoperatorsupport:36,citat:67,cli:66,code:55,compil:[56,58,61,65,66],compilegraph:33,compilespec:[1,45,46,47],conclus:[52,53],construct:57,content:[18,19,20,21,38,39,40,51,52,53],context:60,contigu:55,contract:60,contributor:61,convers:[54,56,58,60],convert:[54,60,62,65],convertgraphtotrtengin:37,cpp:[13,18,19,20,21],creat:[65,67],cudnn:66,current:62,custom:65,cxx11:66,datatyp:1,dead:55,debug:66,defin:[5,6,7,8,9,10,11,12,19,48,49],definit:[18,19,20,21],depend:66,deploi:68,descript:[51,53],deseri:57,detail:53,detect:53,detector:53,develop:59,devic:[2,46],devicetyp:2,dimens:59,directli:70,directori:[13,14,15,16,50],disk:65,distribut:66,dla:71,documen:61,document:[1,2,3,4,5,6,7,8,9,10,11,12,17,23,24,25,26,27,28,29,30,31,32,33,34,35,36,37,45,46,47,59,61],dropout:55,dump_build_info:35,easier:59,elimin:55,eliminatecommonsubexpress:55,engin:57,envior:66,evalu:[54,62],execept:55,executor:57,expect:59,file:[16,18,19,20,21,22,41,42,43,44,48,50],flatten:55,fp16:51,fp32:51,freez:55,from:[66,70],full:[48,49,50],fuse:55,gaurd:55,get:[51,52,61,65],get_build_info:32,get_is_colored_output_on:25,get_logging_prefix:29,get_reportable_log_level:23,gpu:61,graph:[55,57],guarante:60,half:51,hierarchi:[0,22,48],hood:65,how:67,includ:[15,18,19,20,21],indic:61,infer:53,inherit:[3,4],inputrang:47,instal:66,int8cachecalibr:3,int8calibr:4,jetson:66,jit:61,layer:59,learn:[51,52,53],lenet:52,level:17,librari:[66,68],libtrtorch:68,linear:55,link:59,list:[41,42,43,44],local:66,log:[18,23,24,25,26,27,28,29,39,41,63],logsoftmax:55,loop:55,lower:[55,56,58],macro:[19,42],make_int8_cache_calibr:31,make_int8_calibr:30,measur:53,model:[51,52,53],modul:[55,65],multibox:53,namespac:[18,20,21,38,39,40,48,49],nativ:66,native_op:59,nest:[1,2,45,46,47],next:[51,52],node:54,nvidia:61,object:[51,52,53],oper:[62,65],optimz:55,other:60,overview:[51,52,53,58],own:67,packag:[66,68],pass:55,pattern:55,peephol:55,phase:[54,55,56,57,58],post:67,pre:66,precis:51,precompil:66,prerequisit:66,program:[41,42,43,44,68],ptq:[20,30,31,40,43,67],python:[59,61,65,66],pytorch:[52,59,61,70],quantiz:67,quickstart:65,read:59,redund:55,refer:53,regist:65,relationship:[1,2,3,4,45,46,47],releas:66,remov:55,resnet:51,respons:60,result:[53,57],runtim:[56,57,58,68],sampl:53,save:65,script:52,serial:57,set_devic:34,set_is_colored_output_on:26,set_logging_prefix:24,set_reportable_log_level:28,setup:66,shot:53,singl:[51,53],sometim:59,sourc:66,speedup:53,ssd:53,start:[51,52,61,65],str:5,struct:[45,46,47,48,49],subdirectori:[13,14,15],submodul:64,support:62,system:58,tarbal:66,templat:[3,4,30,31],tensorrt:[57,59,66],through:62,time:61,torchscript:[52,61,65],trace:[51,52],train:67,trtorch:[16,18,19,20,21,23,24,25,26,27,28,29,30,31,32,33,34,35,36,37,38,39,40,44,48,51,52,53,59,61,63,64,65,68,70],trtorch_api:6,trtorch_hidden:7,trtorch_major_vers:8,trtorch_minor_vers:12,trtorch_patch_vers:9,trtorch_vers:10,trtorchc:[65,69],tupl:55,type:[3,4,45,46],under:65,unpack:55,unrol:55,unsupport:65,using:66,util:[51,53],visual:53,weight:60,what:[51,52,60],work:65,write:60,xstr:11,your:67}}) \ No newline at end of file +Search.setIndex({docnames:["_cpp_api/class_view_hierarchy","_cpp_api/classtrtorch_1_1CompileSpec_1_1DataType","_cpp_api/classtrtorch_1_1CompileSpec_1_1Device_1_1DeviceType","_cpp_api/classtrtorch_1_1ptq_1_1Int8CacheCalibrator","_cpp_api/classtrtorch_1_1ptq_1_1Int8Calibrator","_cpp_api/define_macros_8h_1a18d295a837ac71add5578860b55e5502","_cpp_api/define_macros_8h_1a20c1fbeb21757871c52299dc52351b5f","_cpp_api/define_macros_8h_1a25ee153c325dfc7466a33cbd5c1ff055","_cpp_api/define_macros_8h_1a48d6029a45583a06848891cb0e86f7ba","_cpp_api/define_macros_8h_1a71b02dddfabe869498ad5a88e11c440f","_cpp_api/define_macros_8h_1a9d31d0569348d109b1b069b972dd143e","_cpp_api/define_macros_8h_1abe87b341f562fd1cf40b7672e4d759da","_cpp_api/define_macros_8h_1ae1c56ab8a40af292a9a4964651524d84","_cpp_api/dir_cpp","_cpp_api/dir_cpp_api","_cpp_api/dir_cpp_api_include","_cpp_api/dir_cpp_api_include_trtorch","_cpp_api/enum_logging_8h_1a5f612ff2f783ff4fbe89d168f0d817d4","_cpp_api/file_cpp_api_include_trtorch_logging.h","_cpp_api/file_cpp_api_include_trtorch_macros.h","_cpp_api/file_cpp_api_include_trtorch_ptq.h","_cpp_api/file_cpp_api_include_trtorch_trtorch.h","_cpp_api/file_view_hierarchy","_cpp_api/function_logging_8h_1a118d65b179defff7fff279eb9cd126cb","_cpp_api/function_logging_8h_1a396a688110397538f8b3fb7dfdaf38bb","_cpp_api/function_logging_8h_1a9b420280bfacc016d7e36a5704021949","_cpp_api/function_logging_8h_1aa533955a2b908db9e5df5acdfa24715f","_cpp_api/function_logging_8h_1abc57d473f3af292551dee8b9c78373ad","_cpp_api/function_logging_8h_1adf5435f0dbb09c0d931a1b851847236b","_cpp_api/function_logging_8h_1aef44b69c62af7cf2edc8875a9506641a","_cpp_api/function_ptq_8h_1a4422781719d7befedb364cacd91c6247","_cpp_api/function_ptq_8h_1a5f33b142bc2f3f2aaf462270b3ad7e31","_cpp_api/function_trtorch_8h_1a2cf17d43ba9117b3b4d652744b4f0447","_cpp_api/function_trtorch_8h_1a3eace458ae9122f571fabfc9ef1b9e3a","_cpp_api/function_trtorch_8h_1a589ea96d16e2df44146ad0919424e00e","_cpp_api/function_trtorch_8h_1a726f6e7091b6b7be45b5a4275b2ffb10","_cpp_api/function_trtorch_8h_1ab01696cfe08b6a5293c55935a9713c25","_cpp_api/function_trtorch_8h_1af19cb866b0520fc84b69a1cf25a52b65","_cpp_api/namespace_trtorch","_cpp_api/namespace_trtorch__logging","_cpp_api/namespace_trtorch__ptq","_cpp_api/program_listing_file_cpp_api_include_trtorch_logging.h","_cpp_api/program_listing_file_cpp_api_include_trtorch_macros.h","_cpp_api/program_listing_file_cpp_api_include_trtorch_ptq.h","_cpp_api/program_listing_file_cpp_api_include_trtorch_trtorch.h","_cpp_api/structtrtorch_1_1CompileSpec","_cpp_api/structtrtorch_1_1CompileSpec_1_1Device","_cpp_api/structtrtorch_1_1CompileSpec_1_1InputRange","_cpp_api/trtorch_cpp","_cpp_api/unabridged_api","_cpp_api/unabridged_orphan","_notebooks/Resnet50-example","_notebooks/lenet-getting-started","_notebooks/ssd-object-detection-demo","contributors/conversion","contributors/lowering","contributors/phases","contributors/runtime","contributors/system_overview","contributors/useful_links","contributors/writing_converters","index","indices/supported_ops","py_api/logging","py_api/trtorch","tutorials/getting_started","tutorials/installation","tutorials/ptq","tutorials/runtime","tutorials/trtorchc","tutorials/use_from_pytorch","tutorials/using_dla"],envversion:{"sphinx.domains.c":2,"sphinx.domains.changeset":1,"sphinx.domains.citation":1,"sphinx.domains.cpp":3,"sphinx.domains.index":1,"sphinx.domains.javascript":2,"sphinx.domains.math":2,"sphinx.domains.python":2,"sphinx.domains.rst":2,"sphinx.domains.std":1,"sphinx.ext.intersphinx":1,nbsphinx:3,sphinx:56},filenames:["_cpp_api/class_view_hierarchy.rst","_cpp_api/classtrtorch_1_1CompileSpec_1_1DataType.rst","_cpp_api/classtrtorch_1_1CompileSpec_1_1Device_1_1DeviceType.rst","_cpp_api/classtrtorch_1_1ptq_1_1Int8CacheCalibrator.rst","_cpp_api/classtrtorch_1_1ptq_1_1Int8Calibrator.rst","_cpp_api/define_macros_8h_1a18d295a837ac71add5578860b55e5502.rst","_cpp_api/define_macros_8h_1a20c1fbeb21757871c52299dc52351b5f.rst","_cpp_api/define_macros_8h_1a25ee153c325dfc7466a33cbd5c1ff055.rst","_cpp_api/define_macros_8h_1a48d6029a45583a06848891cb0e86f7ba.rst","_cpp_api/define_macros_8h_1a71b02dddfabe869498ad5a88e11c440f.rst","_cpp_api/define_macros_8h_1a9d31d0569348d109b1b069b972dd143e.rst","_cpp_api/define_macros_8h_1abe87b341f562fd1cf40b7672e4d759da.rst","_cpp_api/define_macros_8h_1ae1c56ab8a40af292a9a4964651524d84.rst","_cpp_api/dir_cpp.rst","_cpp_api/dir_cpp_api.rst","_cpp_api/dir_cpp_api_include.rst","_cpp_api/dir_cpp_api_include_trtorch.rst","_cpp_api/enum_logging_8h_1a5f612ff2f783ff4fbe89d168f0d817d4.rst","_cpp_api/file_cpp_api_include_trtorch_logging.h.rst","_cpp_api/file_cpp_api_include_trtorch_macros.h.rst","_cpp_api/file_cpp_api_include_trtorch_ptq.h.rst","_cpp_api/file_cpp_api_include_trtorch_trtorch.h.rst","_cpp_api/file_view_hierarchy.rst","_cpp_api/function_logging_8h_1a118d65b179defff7fff279eb9cd126cb.rst","_cpp_api/function_logging_8h_1a396a688110397538f8b3fb7dfdaf38bb.rst","_cpp_api/function_logging_8h_1a9b420280bfacc016d7e36a5704021949.rst","_cpp_api/function_logging_8h_1aa533955a2b908db9e5df5acdfa24715f.rst","_cpp_api/function_logging_8h_1abc57d473f3af292551dee8b9c78373ad.rst","_cpp_api/function_logging_8h_1adf5435f0dbb09c0d931a1b851847236b.rst","_cpp_api/function_logging_8h_1aef44b69c62af7cf2edc8875a9506641a.rst","_cpp_api/function_ptq_8h_1a4422781719d7befedb364cacd91c6247.rst","_cpp_api/function_ptq_8h_1a5f33b142bc2f3f2aaf462270b3ad7e31.rst","_cpp_api/function_trtorch_8h_1a2cf17d43ba9117b3b4d652744b4f0447.rst","_cpp_api/function_trtorch_8h_1a3eace458ae9122f571fabfc9ef1b9e3a.rst","_cpp_api/function_trtorch_8h_1a589ea96d16e2df44146ad0919424e00e.rst","_cpp_api/function_trtorch_8h_1a726f6e7091b6b7be45b5a4275b2ffb10.rst","_cpp_api/function_trtorch_8h_1ab01696cfe08b6a5293c55935a9713c25.rst","_cpp_api/function_trtorch_8h_1af19cb866b0520fc84b69a1cf25a52b65.rst","_cpp_api/namespace_trtorch.rst","_cpp_api/namespace_trtorch__logging.rst","_cpp_api/namespace_trtorch__ptq.rst","_cpp_api/program_listing_file_cpp_api_include_trtorch_logging.h.rst","_cpp_api/program_listing_file_cpp_api_include_trtorch_macros.h.rst","_cpp_api/program_listing_file_cpp_api_include_trtorch_ptq.h.rst","_cpp_api/program_listing_file_cpp_api_include_trtorch_trtorch.h.rst","_cpp_api/structtrtorch_1_1CompileSpec.rst","_cpp_api/structtrtorch_1_1CompileSpec_1_1Device.rst","_cpp_api/structtrtorch_1_1CompileSpec_1_1InputRange.rst","_cpp_api/trtorch_cpp.rst","_cpp_api/unabridged_api.rst","_cpp_api/unabridged_orphan.rst","_notebooks/Resnet50-example.ipynb","_notebooks/lenet-getting-started.ipynb","_notebooks/ssd-object-detection-demo.ipynb","contributors/conversion.rst","contributors/lowering.rst","contributors/phases.rst","contributors/runtime.rst","contributors/system_overview.rst","contributors/useful_links.rst","contributors/writing_converters.rst","index.rst","indices/supported_ops.rst","py_api/logging.rst","py_api/trtorch.rst","tutorials/getting_started.rst","tutorials/installation.rst","tutorials/ptq.rst","tutorials/runtime.rst","tutorials/trtorchc.rst","tutorials/use_from_pytorch.rst","tutorials/using_dla.rst"],objects:{"":{"trtorch::CheckMethodOperatorSupport":[36,1,1,"_CPPv4N7trtorch26CheckMethodOperatorSupportERKN5torch3jit6ModuleENSt6stringE"],"trtorch::CheckMethodOperatorSupport::method_name":[36,2,1,"_CPPv4N7trtorch26CheckMethodOperatorSupportERKN5torch3jit6ModuleENSt6stringE"],"trtorch::CheckMethodOperatorSupport::module":[36,2,1,"_CPPv4N7trtorch26CheckMethodOperatorSupportERKN5torch3jit6ModuleENSt6stringE"],"trtorch::CompileGraph":[33,1,1,"_CPPv4N7trtorch12CompileGraphERKN5torch3jit6ModuleE11CompileSpec"],"trtorch::CompileGraph::info":[33,2,1,"_CPPv4N7trtorch12CompileGraphERKN5torch3jit6ModuleE11CompileSpec"],"trtorch::CompileGraph::module":[33,2,1,"_CPPv4N7trtorch12CompileGraphERKN5torch3jit6ModuleE11CompileSpec"],"trtorch::CompileSpec":[45,3,1,"_CPPv4N7trtorch11CompileSpecE"],"trtorch::CompileSpec::CompileSpec":[45,1,1,"_CPPv4N7trtorch11CompileSpec11CompileSpecENSt6vectorINSt6vectorI7int64_tEEEE"],"trtorch::CompileSpec::CompileSpec::fixed_sizes":[45,2,1,"_CPPv4N7trtorch11CompileSpec11CompileSpecENSt6vectorINSt6vectorI7int64_tEEEE"],"trtorch::CompileSpec::CompileSpec::input_ranges":[45,2,1,"_CPPv4N7trtorch11CompileSpec11CompileSpecENSt6vectorI10InputRangeEE"],"trtorch::CompileSpec::DataType":[45,3,1,"_CPPv4N7trtorch11CompileSpec8DataTypeE"],"trtorch::CompileSpec::DataType::DataType":[45,1,1,"_CPPv4N7trtorch11CompileSpec8DataType8DataTypeEv"],"trtorch::CompileSpec::DataType::DataType::t":[45,2,1,"_CPPv4N7trtorch11CompileSpec8DataType8DataTypeEN3c1010ScalarTypeE"],"trtorch::CompileSpec::DataType::Value":[45,4,1,"_CPPv4N7trtorch11CompileSpec8DataType5ValueE"],"trtorch::CompileSpec::DataType::Value::kChar":[45,5,1,"_CPPv4N7trtorch11CompileSpec8DataType5Value5kCharE"],"trtorch::CompileSpec::DataType::Value::kFloat":[45,5,1,"_CPPv4N7trtorch11CompileSpec8DataType5Value6kFloatE"],"trtorch::CompileSpec::DataType::Value::kHalf":[45,5,1,"_CPPv4N7trtorch11CompileSpec8DataType5Value5kHalfE"],"trtorch::CompileSpec::DataType::kChar":[1,5,1,"_CPPv4N7trtorch11CompileSpec8DataType5Value5kCharE"],"trtorch::CompileSpec::DataType::kFloat":[1,5,1,"_CPPv4N7trtorch11CompileSpec8DataType5Value6kFloatE"],"trtorch::CompileSpec::DataType::kHalf":[1,5,1,"_CPPv4N7trtorch11CompileSpec8DataType5Value5kHalfE"],"trtorch::CompileSpec::DataType::operator Value":[45,1,1,"_CPPv4NK7trtorch11CompileSpec8DataTypecv5ValueEv"],"trtorch::CompileSpec::DataType::operator bool":[45,1,1,"_CPPv4N7trtorch11CompileSpec8DataTypecvbEv"],"trtorch::CompileSpec::DataType::operator!=":[45,1,1,"_CPPv4NK7trtorch11CompileSpec8DataTypeneEN8DataType5ValueE"],"trtorch::CompileSpec::DataType::operator!=::other":[45,2,1,"_CPPv4NK7trtorch11CompileSpec8DataTypeneEN8DataType5ValueE"],"trtorch::CompileSpec::DataType::operator==":[45,1,1,"_CPPv4NK7trtorch11CompileSpec8DataTypeeqEN8DataType5ValueE"],"trtorch::CompileSpec::DataType::operator==::other":[45,2,1,"_CPPv4NK7trtorch11CompileSpec8DataTypeeqEN8DataType5ValueE"],"trtorch::CompileSpec::Device":[46,3,1,"_CPPv4N7trtorch11CompileSpec6DeviceE"],"trtorch::CompileSpec::Device::Device":[46,1,1,"_CPPv4N7trtorch11CompileSpec6Device6DeviceEv"],"trtorch::CompileSpec::Device::DeviceType":[46,3,1,"_CPPv4N7trtorch11CompileSpec6Device10DeviceTypeE"],"trtorch::CompileSpec::Device::DeviceType::DeviceType":[46,1,1,"_CPPv4N7trtorch11CompileSpec6Device10DeviceType10DeviceTypeEv"],"trtorch::CompileSpec::Device::DeviceType::DeviceType::t":[46,2,1,"_CPPv4N7trtorch11CompileSpec6Device10DeviceType10DeviceTypeEN3c1010DeviceTypeE"],"trtorch::CompileSpec::Device::DeviceType::Value":[46,4,1,"_CPPv4N7trtorch11CompileSpec6Device10DeviceType5ValueE"],"trtorch::CompileSpec::Device::DeviceType::Value::kDLA":[46,5,1,"_CPPv4N7trtorch11CompileSpec6Device10DeviceType5Value4kDLAE"],"trtorch::CompileSpec::Device::DeviceType::Value::kGPU":[46,5,1,"_CPPv4N7trtorch11CompileSpec6Device10DeviceType5Value4kGPUE"],"trtorch::CompileSpec::Device::DeviceType::kDLA":[2,5,1,"_CPPv4N7trtorch11CompileSpec6Device10DeviceType5Value4kDLAE"],"trtorch::CompileSpec::Device::DeviceType::kGPU":[2,5,1,"_CPPv4N7trtorch11CompileSpec6Device10DeviceType5Value4kGPUE"],"trtorch::CompileSpec::Device::DeviceType::operator Value":[46,1,1,"_CPPv4NK7trtorch11CompileSpec6Device10DeviceTypecv5ValueEv"],"trtorch::CompileSpec::Device::DeviceType::operator bool":[46,1,1,"_CPPv4N7trtorch11CompileSpec6Device10DeviceTypecvbEv"],"trtorch::CompileSpec::Device::DeviceType::operator!=":[46,1,1,"_CPPv4NK7trtorch11CompileSpec6Device10DeviceTypeneE10DeviceType"],"trtorch::CompileSpec::Device::DeviceType::operator!=::other":[46,2,1,"_CPPv4NK7trtorch11CompileSpec6Device10DeviceTypeneE10DeviceType"],"trtorch::CompileSpec::Device::DeviceType::operator==":[46,1,1,"_CPPv4NK7trtorch11CompileSpec6Device10DeviceTypeeqE10DeviceType"],"trtorch::CompileSpec::Device::DeviceType::operator==::other":[46,2,1,"_CPPv4NK7trtorch11CompileSpec6Device10DeviceTypeeqE10DeviceType"],"trtorch::CompileSpec::Device::allow_gpu_fallback":[46,6,1,"_CPPv4N7trtorch11CompileSpec6Device18allow_gpu_fallbackE"],"trtorch::CompileSpec::Device::device_type":[46,6,1,"_CPPv4N7trtorch11CompileSpec6Device11device_typeE"],"trtorch::CompileSpec::Device::dla_core":[46,6,1,"_CPPv4N7trtorch11CompileSpec6Device8dla_coreE"],"trtorch::CompileSpec::Device::gpu_id":[46,6,1,"_CPPv4N7trtorch11CompileSpec6Device6gpu_idE"],"trtorch::CompileSpec::EngineCapability":[45,4,1,"_CPPv4N7trtorch11CompileSpec16EngineCapabilityE"],"trtorch::CompileSpec::EngineCapability::kDEFAULT":[45,5,1,"_CPPv4N7trtorch11CompileSpec16EngineCapability8kDEFAULTE"],"trtorch::CompileSpec::EngineCapability::kSAFE_DLA":[45,5,1,"_CPPv4N7trtorch11CompileSpec16EngineCapability9kSAFE_DLAE"],"trtorch::CompileSpec::EngineCapability::kSAFE_GPU":[45,5,1,"_CPPv4N7trtorch11CompileSpec16EngineCapability9kSAFE_GPUE"],"trtorch::CompileSpec::InputRange":[47,3,1,"_CPPv4N7trtorch11CompileSpec10InputRangeE"],"trtorch::CompileSpec::InputRange::InputRange":[47,1,1,"_CPPv4N7trtorch11CompileSpec10InputRange10InputRangeENSt6vectorI7int64_tEENSt6vectorI7int64_tEENSt6vectorI7int64_tEE"],"trtorch::CompileSpec::InputRange::InputRange::max":[47,2,1,"_CPPv4N7trtorch11CompileSpec10InputRange10InputRangeENSt6vectorI7int64_tEENSt6vectorI7int64_tEENSt6vectorI7int64_tEE"],"trtorch::CompileSpec::InputRange::InputRange::min":[47,2,1,"_CPPv4N7trtorch11CompileSpec10InputRange10InputRangeENSt6vectorI7int64_tEENSt6vectorI7int64_tEENSt6vectorI7int64_tEE"],"trtorch::CompileSpec::InputRange::InputRange::opt":[47,2,1,"_CPPv4N7trtorch11CompileSpec10InputRange10InputRangeENSt6vectorI7int64_tEENSt6vectorI7int64_tEENSt6vectorI7int64_tEE"],"trtorch::CompileSpec::InputRange::max":[47,6,1,"_CPPv4N7trtorch11CompileSpec10InputRange3maxE"],"trtorch::CompileSpec::InputRange::min":[47,6,1,"_CPPv4N7trtorch11CompileSpec10InputRange3minE"],"trtorch::CompileSpec::InputRange::opt":[47,6,1,"_CPPv4N7trtorch11CompileSpec10InputRange3optE"],"trtorch::CompileSpec::capability":[45,6,1,"_CPPv4N7trtorch11CompileSpec10capabilityE"],"trtorch::CompileSpec::debug":[45,6,1,"_CPPv4N7trtorch11CompileSpec5debugE"],"trtorch::CompileSpec::device":[45,6,1,"_CPPv4N7trtorch11CompileSpec6deviceE"],"trtorch::CompileSpec::disable_tf32":[45,6,1,"_CPPv4N7trtorch11CompileSpec12disable_tf32E"],"trtorch::CompileSpec::input_ranges":[45,6,1,"_CPPv4N7trtorch11CompileSpec12input_rangesE"],"trtorch::CompileSpec::kDEFAULT":[45,5,1,"_CPPv4N7trtorch11CompileSpec16EngineCapability8kDEFAULTE"],"trtorch::CompileSpec::kSAFE_DLA":[45,5,1,"_CPPv4N7trtorch11CompileSpec16EngineCapability9kSAFE_DLAE"],"trtorch::CompileSpec::kSAFE_GPU":[45,5,1,"_CPPv4N7trtorch11CompileSpec16EngineCapability9kSAFE_GPUE"],"trtorch::CompileSpec::max_batch_size":[45,6,1,"_CPPv4N7trtorch11CompileSpec14max_batch_sizeE"],"trtorch::CompileSpec::num_avg_timing_iters":[45,6,1,"_CPPv4N7trtorch11CompileSpec20num_avg_timing_itersE"],"trtorch::CompileSpec::num_min_timing_iters":[45,6,1,"_CPPv4N7trtorch11CompileSpec20num_min_timing_itersE"],"trtorch::CompileSpec::op_precision":[45,6,1,"_CPPv4N7trtorch11CompileSpec12op_precisionE"],"trtorch::CompileSpec::ptq_calibrator":[45,6,1,"_CPPv4N7trtorch11CompileSpec14ptq_calibratorE"],"trtorch::CompileSpec::refit":[45,6,1,"_CPPv4N7trtorch11CompileSpec5refitE"],"trtorch::CompileSpec::strict_types":[45,6,1,"_CPPv4N7trtorch11CompileSpec12strict_typesE"],"trtorch::CompileSpec::workspace_size":[45,6,1,"_CPPv4N7trtorch11CompileSpec14workspace_sizeE"],"trtorch::ConvertGraphToTRTEngine":[37,1,1,"_CPPv4N7trtorch23ConvertGraphToTRTEngineERKN5torch3jit6ModuleENSt6stringE11CompileSpec"],"trtorch::ConvertGraphToTRTEngine::info":[37,2,1,"_CPPv4N7trtorch23ConvertGraphToTRTEngineERKN5torch3jit6ModuleENSt6stringE11CompileSpec"],"trtorch::ConvertGraphToTRTEngine::method_name":[37,2,1,"_CPPv4N7trtorch23ConvertGraphToTRTEngineERKN5torch3jit6ModuleENSt6stringE11CompileSpec"],"trtorch::ConvertGraphToTRTEngine::module":[37,2,1,"_CPPv4N7trtorch23ConvertGraphToTRTEngineERKN5torch3jit6ModuleENSt6stringE11CompileSpec"],"trtorch::dump_build_info":[35,1,1,"_CPPv4N7trtorch15dump_build_infoEv"],"trtorch::get_build_info":[32,1,1,"_CPPv4N7trtorch14get_build_infoEv"],"trtorch::logging::Level":[17,4,1,"_CPPv4N7trtorch7logging5LevelE"],"trtorch::logging::Level::kDEBUG":[17,5,1,"_CPPv4N7trtorch7logging5Level6kDEBUGE"],"trtorch::logging::Level::kERROR":[17,5,1,"_CPPv4N7trtorch7logging5Level6kERRORE"],"trtorch::logging::Level::kGRAPH":[17,5,1,"_CPPv4N7trtorch7logging5Level6kGRAPHE"],"trtorch::logging::Level::kINFO":[17,5,1,"_CPPv4N7trtorch7logging5Level5kINFOE"],"trtorch::logging::Level::kINTERNAL_ERROR":[17,5,1,"_CPPv4N7trtorch7logging5Level15kINTERNAL_ERRORE"],"trtorch::logging::Level::kWARNING":[17,5,1,"_CPPv4N7trtorch7logging5Level8kWARNINGE"],"trtorch::logging::get_is_colored_output_on":[25,1,1,"_CPPv4N7trtorch7logging24get_is_colored_output_onEv"],"trtorch::logging::get_logging_prefix":[29,1,1,"_CPPv4N7trtorch7logging18get_logging_prefixEv"],"trtorch::logging::get_reportable_log_level":[23,1,1,"_CPPv4N7trtorch7logging24get_reportable_log_levelEv"],"trtorch::logging::kDEBUG":[17,5,1,"_CPPv4N7trtorch7logging5Level6kDEBUGE"],"trtorch::logging::kERROR":[17,5,1,"_CPPv4N7trtorch7logging5Level6kERRORE"],"trtorch::logging::kGRAPH":[17,5,1,"_CPPv4N7trtorch7logging5Level6kGRAPHE"],"trtorch::logging::kINFO":[17,5,1,"_CPPv4N7trtorch7logging5Level5kINFOE"],"trtorch::logging::kINTERNAL_ERROR":[17,5,1,"_CPPv4N7trtorch7logging5Level15kINTERNAL_ERRORE"],"trtorch::logging::kWARNING":[17,5,1,"_CPPv4N7trtorch7logging5Level8kWARNINGE"],"trtorch::logging::log":[27,1,1,"_CPPv4N7trtorch7logging3logE5LevelNSt6stringE"],"trtorch::logging::log::lvl":[27,2,1,"_CPPv4N7trtorch7logging3logE5LevelNSt6stringE"],"trtorch::logging::log::msg":[27,2,1,"_CPPv4N7trtorch7logging3logE5LevelNSt6stringE"],"trtorch::logging::set_is_colored_output_on":[26,1,1,"_CPPv4N7trtorch7logging24set_is_colored_output_onEb"],"trtorch::logging::set_is_colored_output_on::colored_output_on":[26,2,1,"_CPPv4N7trtorch7logging24set_is_colored_output_onEb"],"trtorch::logging::set_logging_prefix":[24,1,1,"_CPPv4N7trtorch7logging18set_logging_prefixENSt6stringE"],"trtorch::logging::set_logging_prefix::prefix":[24,2,1,"_CPPv4N7trtorch7logging18set_logging_prefixENSt6stringE"],"trtorch::logging::set_reportable_log_level":[28,1,1,"_CPPv4N7trtorch7logging24set_reportable_log_levelE5Level"],"trtorch::logging::set_reportable_log_level::lvl":[28,2,1,"_CPPv4N7trtorch7logging24set_reportable_log_levelE5Level"],"trtorch::ptq::Int8CacheCalibrator":[3,3,1,"_CPPv4I0EN7trtorch3ptq19Int8CacheCalibratorE"],"trtorch::ptq::Int8CacheCalibrator::Algorithm":[3,7,1,"_CPPv4I0EN7trtorch3ptq19Int8CacheCalibratorE"],"trtorch::ptq::Int8CacheCalibrator::Int8CacheCalibrator":[3,1,1,"_CPPv4N7trtorch3ptq19Int8CacheCalibrator19Int8CacheCalibratorERKNSt6stringE"],"trtorch::ptq::Int8CacheCalibrator::Int8CacheCalibrator::cache_file_path":[3,2,1,"_CPPv4N7trtorch3ptq19Int8CacheCalibrator19Int8CacheCalibratorERKNSt6stringE"],"trtorch::ptq::Int8CacheCalibrator::getBatch":[3,1,1,"_CPPv4N7trtorch3ptq19Int8CacheCalibrator8getBatchEA_PvA_PKci"],"trtorch::ptq::Int8CacheCalibrator::getBatch::bindings":[3,2,1,"_CPPv4N7trtorch3ptq19Int8CacheCalibrator8getBatchEA_PvA_PKci"],"trtorch::ptq::Int8CacheCalibrator::getBatch::names":[3,2,1,"_CPPv4N7trtorch3ptq19Int8CacheCalibrator8getBatchEA_PvA_PKci"],"trtorch::ptq::Int8CacheCalibrator::getBatch::nbBindings":[3,2,1,"_CPPv4N7trtorch3ptq19Int8CacheCalibrator8getBatchEA_PvA_PKci"],"trtorch::ptq::Int8CacheCalibrator::getBatchSize":[3,1,1,"_CPPv4NK7trtorch3ptq19Int8CacheCalibrator12getBatchSizeEv"],"trtorch::ptq::Int8CacheCalibrator::operator nvinfer1::IInt8Calibrator*":[3,1,1,"_CPPv4N7trtorch3ptq19Int8CacheCalibratorcvPN8nvinfer115IInt8CalibratorEEv"],"trtorch::ptq::Int8CacheCalibrator::readCalibrationCache":[3,1,1,"_CPPv4N7trtorch3ptq19Int8CacheCalibrator20readCalibrationCacheER6size_t"],"trtorch::ptq::Int8CacheCalibrator::readCalibrationCache::length":[3,2,1,"_CPPv4N7trtorch3ptq19Int8CacheCalibrator20readCalibrationCacheER6size_t"],"trtorch::ptq::Int8CacheCalibrator::writeCalibrationCache":[3,1,1,"_CPPv4N7trtorch3ptq19Int8CacheCalibrator21writeCalibrationCacheEPKv6size_t"],"trtorch::ptq::Int8CacheCalibrator::writeCalibrationCache::cache":[3,2,1,"_CPPv4N7trtorch3ptq19Int8CacheCalibrator21writeCalibrationCacheEPKv6size_t"],"trtorch::ptq::Int8CacheCalibrator::writeCalibrationCache::length":[3,2,1,"_CPPv4N7trtorch3ptq19Int8CacheCalibrator21writeCalibrationCacheEPKv6size_t"],"trtorch::ptq::Int8Calibrator":[4,3,1,"_CPPv4I00EN7trtorch3ptq14Int8CalibratorE"],"trtorch::ptq::Int8Calibrator::Algorithm":[4,7,1,"_CPPv4I00EN7trtorch3ptq14Int8CalibratorE"],"trtorch::ptq::Int8Calibrator::DataLoaderUniquePtr":[4,7,1,"_CPPv4I00EN7trtorch3ptq14Int8CalibratorE"],"trtorch::ptq::Int8Calibrator::Int8Calibrator":[4,1,1,"_CPPv4N7trtorch3ptq14Int8Calibrator14Int8CalibratorE19DataLoaderUniquePtrRKNSt6stringEb"],"trtorch::ptq::Int8Calibrator::Int8Calibrator::cache_file_path":[4,2,1,"_CPPv4N7trtorch3ptq14Int8Calibrator14Int8CalibratorE19DataLoaderUniquePtrRKNSt6stringEb"],"trtorch::ptq::Int8Calibrator::Int8Calibrator::dataloader":[4,2,1,"_CPPv4N7trtorch3ptq14Int8Calibrator14Int8CalibratorE19DataLoaderUniquePtrRKNSt6stringEb"],"trtorch::ptq::Int8Calibrator::Int8Calibrator::use_cache":[4,2,1,"_CPPv4N7trtorch3ptq14Int8Calibrator14Int8CalibratorE19DataLoaderUniquePtrRKNSt6stringEb"],"trtorch::ptq::Int8Calibrator::getBatch":[4,1,1,"_CPPv4N7trtorch3ptq14Int8Calibrator8getBatchEA_PvA_PKci"],"trtorch::ptq::Int8Calibrator::getBatch::bindings":[4,2,1,"_CPPv4N7trtorch3ptq14Int8Calibrator8getBatchEA_PvA_PKci"],"trtorch::ptq::Int8Calibrator::getBatch::names":[4,2,1,"_CPPv4N7trtorch3ptq14Int8Calibrator8getBatchEA_PvA_PKci"],"trtorch::ptq::Int8Calibrator::getBatch::nbBindings":[4,2,1,"_CPPv4N7trtorch3ptq14Int8Calibrator8getBatchEA_PvA_PKci"],"trtorch::ptq::Int8Calibrator::getBatchSize":[4,1,1,"_CPPv4NK7trtorch3ptq14Int8Calibrator12getBatchSizeEv"],"trtorch::ptq::Int8Calibrator::operator nvinfer1::IInt8Calibrator*":[4,1,1,"_CPPv4N7trtorch3ptq14Int8CalibratorcvPN8nvinfer115IInt8CalibratorEEv"],"trtorch::ptq::Int8Calibrator::readCalibrationCache":[4,1,1,"_CPPv4N7trtorch3ptq14Int8Calibrator20readCalibrationCacheER6size_t"],"trtorch::ptq::Int8Calibrator::readCalibrationCache::length":[4,2,1,"_CPPv4N7trtorch3ptq14Int8Calibrator20readCalibrationCacheER6size_t"],"trtorch::ptq::Int8Calibrator::writeCalibrationCache":[4,1,1,"_CPPv4N7trtorch3ptq14Int8Calibrator21writeCalibrationCacheEPKv6size_t"],"trtorch::ptq::Int8Calibrator::writeCalibrationCache::cache":[4,2,1,"_CPPv4N7trtorch3ptq14Int8Calibrator21writeCalibrationCacheEPKv6size_t"],"trtorch::ptq::Int8Calibrator::writeCalibrationCache::length":[4,2,1,"_CPPv4N7trtorch3ptq14Int8Calibrator21writeCalibrationCacheEPKv6size_t"],"trtorch::ptq::make_int8_cache_calibrator":[31,1,1,"_CPPv4I0EN7trtorch3ptq26make_int8_cache_calibratorE19Int8CacheCalibratorI9AlgorithmERKNSt6stringE"],"trtorch::ptq::make_int8_cache_calibrator::Algorithm":[31,7,1,"_CPPv4I0EN7trtorch3ptq26make_int8_cache_calibratorE19Int8CacheCalibratorI9AlgorithmERKNSt6stringE"],"trtorch::ptq::make_int8_cache_calibrator::cache_file_path":[31,2,1,"_CPPv4I0EN7trtorch3ptq26make_int8_cache_calibratorE19Int8CacheCalibratorI9AlgorithmERKNSt6stringE"],"trtorch::ptq::make_int8_calibrator":[30,1,1,"_CPPv4I00EN7trtorch3ptq20make_int8_calibratorE14Int8CalibratorI9Algorithm10DataLoaderE10DataLoaderRKNSt6stringEb"],"trtorch::ptq::make_int8_calibrator::Algorithm":[30,7,1,"_CPPv4I00EN7trtorch3ptq20make_int8_calibratorE14Int8CalibratorI9Algorithm10DataLoaderE10DataLoaderRKNSt6stringEb"],"trtorch::ptq::make_int8_calibrator::DataLoader":[30,7,1,"_CPPv4I00EN7trtorch3ptq20make_int8_calibratorE14Int8CalibratorI9Algorithm10DataLoaderE10DataLoaderRKNSt6stringEb"],"trtorch::ptq::make_int8_calibrator::cache_file_path":[30,2,1,"_CPPv4I00EN7trtorch3ptq20make_int8_calibratorE14Int8CalibratorI9Algorithm10DataLoaderE10DataLoaderRKNSt6stringEb"],"trtorch::ptq::make_int8_calibrator::dataloader":[30,2,1,"_CPPv4I00EN7trtorch3ptq20make_int8_calibratorE14Int8CalibratorI9Algorithm10DataLoaderE10DataLoaderRKNSt6stringEb"],"trtorch::ptq::make_int8_calibrator::use_cache":[30,2,1,"_CPPv4I00EN7trtorch3ptq20make_int8_calibratorE14Int8CalibratorI9Algorithm10DataLoaderE10DataLoaderRKNSt6stringEb"],"trtorch::set_device":[34,1,1,"_CPPv4N7trtorch10set_deviceEKi"],"trtorch::set_device::gpu_id":[34,2,1,"_CPPv4N7trtorch10set_deviceEKi"],STR:[5,0,1,"c.STR"],TRTORCH_API:[6,0,1,"c.TRTORCH_API"],TRTORCH_HIDDEN:[7,0,1,"c.TRTORCH_HIDDEN"],TRTORCH_MAJOR_VERSION:[8,0,1,"c.TRTORCH_MAJOR_VERSION"],TRTORCH_MINOR_VERSION:[12,0,1,"c.TRTORCH_MINOR_VERSION"],TRTORCH_PATCH_VERSION:[9,0,1,"c.TRTORCH_PATCH_VERSION"],TRTORCH_VERSION:[10,0,1,"c.TRTORCH_VERSION"],XSTR:[11,0,1,"c.XSTR"],trtorch:[64,8,0,"-"]},"trtorch.logging":{Level:[63,9,1,""],get_is_colored_output_on:[63,10,1,""],get_logging_prefix:[63,10,1,""],get_reportable_log_level:[63,10,1,""],log:[63,10,1,""],set_is_colored_output_on:[63,10,1,""],set_logging_prefix:[63,10,1,""],set_reportable_log_level:[63,10,1,""]},"trtorch.logging.Level":{Debug:[63,11,1,""],Error:[63,11,1,""],Info:[63,11,1,""],InternalError:[63,11,1,""],Warning:[63,11,1,""]},trtorch:{DeviceType:[64,9,1,""],EngineCapability:[64,9,1,""],TensorRTCompileSpec:[64,10,1,""],check_method_op_support:[64,10,1,""],compile:[64,10,1,""],convert_method_to_trt_engine:[64,10,1,""],dtype:[64,9,1,""],dump_build_info:[64,10,1,""],get_build_info:[64,10,1,""],logging:[63,8,0,"-"],set_device:[64,10,1,""]}},objnames:{"0":["c","macro","C macro"],"1":["cpp","function","C++ function"],"10":["py","function","Python function"],"11":["py","attribute","Python attribute"],"2":["cpp","functionParam","functionParam"],"3":["cpp","class","C++ class"],"4":["cpp","enum","C++ enum"],"5":["cpp","enumerator","C++ enumerator"],"6":["cpp","member","C++ member"],"7":["cpp","templateParam","templateParam"],"8":["py","module","Python module"],"9":["py","class","Python class"]},objtypes:{"0":"c:macro","1":"cpp:function","10":"py:function","11":"py:attribute","2":"cpp:functionParam","3":"cpp:class","4":"cpp:enum","5":"cpp:enumerator","6":"cpp:member","7":"cpp:templateParam","8":"py:module","9":"py:class"},terms:{"001s":51,"00f1b6db":51,"01s":51,"04s":51,"07s":51,"0c106ec84f199a0fbcf1199010166986da732f9b0907768c9ac5ea5b120772db":66,"0x7fb23f032618":64,"11k":51,"12a":51,"16280mib":51,"1x1":53,"24k":51,"2_20200626":66,"2c365_subsampl":51,"2mib":51,"300w":51,"300x300":53,"31c":51,"32w":51,"32x32":51,"33c":51,"33w":51,"34c":51,"34w":51,"353k":51,"35c":51,"35k":51,"35w":51,"36c":51,"37c":51,"43w":51,"442k":51,"4fef":51,"53k":51,"55k":51,"774kb":51,"818977576572eadaf62c80434a25afe44dbaa32ebda3a0919e389dcbe74f8656":66,"81k":51,"84e944ff11f8":51,"891mib":51,"9205bed204e2ae7aafd2e01cce0f21309e281e18d5bfd7172ef8541771539d41":66,"94k":51,"9ab0":51,"abstract":[57,60],"byte":64,"case":[1,2,45,46,52,53,54,57,60,66,67],"catch":[55,65],"char":[3,4,43,65],"class":[30,31,43,44,45,46,50,51,52,53,57,60,63,64,65,67],"const":[1,2,3,4,30,31,33,34,36,37,43,44,45,46,55,60,62,65,67],"default":[1,2,3,4,17,30,31,42,44,45,46,51,53,64,65,67,69,70],"enum":[1,2,41,44,45,46,50,63,67],"export":66,"final":[54,56,58,66],"float":[62,64,65,69],"function":[1,2,3,4,45,46,47,50,51,52,53,55,57,60,65,67,70,71],"import":[51,52,53,55,65,68,69,70],"int":[3,4,34,43,44,62,65],"long":54,"new":[1,2,3,4,33,45,46,47,51,52,57,58,60,63,65],"public":[1,2,3,4,43,44,45,46,47,67],"return":[1,2,3,4,23,25,30,31,32,33,36,37,41,42,43,44,45,46,51,52,55,56,57,58,60,63,64,65,67],"short":55,"static":[45,47,54,60,64,65],"super":[43,52,65],"throw":[55,65],"true":[1,2,4,45,46,51,52,53,55,60,62,64,65,67,70,71],"try":[51,52,58,65,70],"var":62,"void":[3,4,24,26,27,28,34,35,41,43,44],"while":67,And:65,Are:41,Bus:51,But:65,For:[51,52,53,54,65,66,67,68,70],IDs:53,Its:60,Not:3,One:[64,65],PRs:65,Thats:65,The:[2,45,46,51,52,53,54,55,56,57,58,60,63,66,67,69,70],Then:[66,67,70],There:[4,51,53,54,60,65,67,68],These:[54,57,67],Use:[45,60,64,67],Useful:61,Using:[4,51,53,61,71],Will:36,With:[51,65,67],___torch_mangle_10:65,___torch_mangle_4847:57,___torch_mangle_5:65,___torch_mangle_9:65,__and__:62,__attribute__:42,__getitem__:62,__gnuc__:42,__init__:[52,65],__is__:62,__isnot__:62,__not__:62,__or__:62,__round_to_zero_floordiv:62,__torch__:[57,65],__torch___pytorch_detection_ssd_src_model_ssd300_trt_engin:57,__torch___torchvision_models_resnet____torch_mangle_4847_resnet_trt_engin:57,__visibility__:42,__xor__:62,_all_:55,_convolut:[62,65],_jit_to_backend:70,_jit_to_tensorrt:64,_script:64,a100:[51,52],aarch64:58,abi:68,abl:[51,52,54,55,60,61,67,70],about:[53,54,57,60,64,65,69],abov:[28,53,65],abs:62,acceler:[51,52,65,71],accept:[45,47,57,60,69],access:[53,55,60,61,65,70],accord:60,accumul:[45,64],accuraci:[53,67],achiev:[51,52],aco:62,acosh:62,across:55,acthardtanh:60,activ:[65,67,71],activationtyp:60,actual:[52,55,57,60,63,65],adaptive_avg_pool2d:62,adaptiveavgpool2d:51,add:[27,54,55,60,62,63,65,66],add_:[55,62,65],add_patch:53,addactiv:60,added:[28,54],addit:[53,55,65],addlay:65,addshuffl:65,advanc:67,affin:51,after:[53,54,61,65,68,69],again:[43,53,57,60],against:[65,69],agre:[51,52,53],agx:44,ahead:65,aim:55,algo_typ:67,algorithm:[3,4,30,31,43,67],align_corn:62,all:[17,41,42,43,44,51,52,53,55,57,64,65,67,68,69],alloc:60,allow:[45,47,51,52,53,54,55,64,69],allow_gpu_fallback:[44,45,46,64,67,70,71],allow_tf32:62,almost:65,alpha:[53,62],alreadi:[51,54,55,65,67,69],also:[31,51,52,53,54,60,61,65,66,67],alwai:[3,4,26],amazonaw:51,amp:51,analog:65,analogu:60,analysi:[51,53],ani:[51,52,53,54,60,64,65,66,67,69],annot:[53,60,65],anoth:65,aot:[61,65],apach:[51,52,53],apex:53,api:[13,15,16,41,42,43,44,58,60,64,65,67,68,70],apidirectori:[22,48],append:[51,52,53,62],appli:67,applic:[2,31,45,46,51,52,53,55,58,65,68,69,70,71],approach:[51,52],apr:65,aquir:65,architectur:[53,61,66],archiv:66,aren:65,arg:[54,65],argc:65,argmax:51,argument:[55,57,60,65,69],argv:65,around:[57,60,65],arrai:[3,4,54],arrayref:[44,45,47],arti:51,arxiv:67,asin:62,asinh:62,aspect:69,assembl:[54,65],assign:[3,4],associ:[54,60,65],associatevalueandivalu:60,associatevalueandtensor:[60,65],assum:70,atan:62,atanh:62,aten:[55,59,60,62,65],attach:53,attribut:[55,57,65],aug:51,auto:[43,60,65,67,71],automat:[51,52,65],avail:[51,52,53,60,66,71],ave:[51,52],averag:[45,51,52,53,64,69],avg:[53,69],avg_pool1d:62,avg_pool2d:62,avg_pool3d:62,avgpool:[51,53],avoid:51,await:51,axes:51,axi:51,b_hh:62,b_ih:62,back:[55,57,58,65],back_insert:43,backbon:53,backend:[51,52,53,64,70],background:53,base:[35,48,49,51,52,53,57,63,65,66,67],bash:[53,66],basi:[51,52,53],basic:69,batch:[3,4,43,45,51,52,53,64,67,69,71],batch_norm:[60,62],batch_siz:[43,53,67],batched_data_:43,batchnorm2d:51,batchnorm:[53,55],batchtyp:43,bazel:[58,66],bazel_vers:66,bazelbuild:66,bazelisk:66,bazelvers:66,bbox:53,bdist_wheel:66,becaus:[60,65,66],becom:60,been:[54,60,65],befor:[45,53,55,58,60,61,64,65,66],begin:[43,66],beginn:65,behav:[51,53],behavior:[45,64],being:65,below:[53,60,65],benchmark:[52,62],benefit:[60,65],best:[45,47,51,52,66],best_result:53,best_results_per_input:53,best_results_per_input_trt:53,beta:62,better:[51,52,53,65,67],between:[53,60,67],bia:[51,52,55,62,65],bin:[51,66],binari:[43,67],bind:[3,4,43],bird:51,bit:[45,60,64,65],blob:[59,67],block0:55,block1:55,block:[54,55],bn1:51,bn2:51,bn3:51,bool:[1,2,3,4,25,26,30,36,41,43,44,45,46,55,60,62,63,64,65,67],bot:53,both:[51,52,53,65,66,67],bottleneck:51,bound:53,box:53,branch:66,breed:51,briefli:65,bsd:[41,42,43,44],buffer:[3,4],bug:66,build:[30,31,32,45,54,56,58,60,64,65,67,69],build_fil:66,builderconfig:44,built:[58,66,69],bust:51,bzl:66,c10:[1,2,44,45,46,47,65,67],c96b:51,c_api:59,c_str:[60,65],cach:[3,4,30,31,43,51,53,65,67,69],cache_:43,cache_fil:[43,67],cache_file_path:[3,4,30,31,43],cache_file_path_:43,cache_size_:43,cachecalibr:67,calcul:[54,65],calibr:[3,4,30,31,43,45,65,67,69],calibration_cache_fil:[30,31,67],calibration_dataload:[30,67],calibration_dataset:67,calibrationalgo:67,call:[30,31,33,45,51,52,53,55,57,60,64,65,70],callmethod:65,can:[1,2,4,30,31,37,45,46,47,51,52,53,54,55,56,57,58,60,64,65,66,67,68,69,70],cannot:[51,52,53,55,65],cap:51,capabl:[44,45,64,69,70],captur:53,cast:[3,4,55],cat:[62,66],caught:55,caus:[60,66],cdll:65,ceil:62,ceil_mod:[51,62],cell:53,centercrop:51,cerr:65,certifi:51,cf0691493d05062fe3239cf76773bae4c5124f4b039050dbdd291c652af3ab2a:66,chain:60,chanc:60,chang:[31,51,52,55,58,67],channel:51,check:[1,2,36,45,46,53,55,60,64,65,66,68,69],check_method_op_support:64,checkmethodoperatorsupport:[21,38,44,48,49,65],checkpoint:53,checkpoint_from_distribut:53,chimpansee_amber_r_1920x1080:51,chimpanze:51,choos:[65,66],cifar10:67,cifar:67,clamp:62,classes_to_label:53,classif:[52,53,65],classifi:52,clear:43,cli:[65,69],close:65,closer:55,cloudfront:51,coco:53,cocodataset:53,code:[51,52,53,58,61,65,67],collect:65,color:[25,26,63],colored_output_on:[26,41,63],com:[51,52,59,65,66,67],come:[51,52],command:[51,65,66,69],comment:66,common:[51,53,54,55],common_subexpression_elimin:55,commun:65,compar:53,comparis:[1,45],comparison:[2,45,46],compat:[1,2,45,46,55,57,66],compil:[33,36,37,45,51,52,53,55,57,60,64,67,68,69,70,71],compile_set:[52,65,67],compile_spec:[64,67,71],compilegraph:[21,38,44,48,49,65,67],compilespec:[0,2,3,4,21,33,37,38,44,48,49,64,65,67,71],compilespecstruct:[0,48],complet:[51,52,53,65],complex:65,compli:53,complianc:[51,52,53],compliat:67,compon:[52,56,58,65,68],compos:[51,52,53,65,67],composit:65,comprehens:53,comput:[45,51,52,53,66,67],conclus:51,condit:[51,52,53],confid:[51,53],config:66,configur:[33,37,61,64,65,66,67],connect:[51,55,71],consid:[51,65],consol:69,consolid:65,constant:[54,55,65],constexpr:[1,2,44,45,46],construct:[1,2,3,4,45,46,47,54,55,56,58,60,65,67],constructor:[1,45,46,57,65],consum:[4,54,65],contain:[30,36,51,52,53,54,55,60,64,65,66,67,68],content:67,context:[54,56,57,58],continu:[51,52,53,68],contributor:65,control:[51,52,53,65],conv1:[51,52,65],conv2:[51,52,65],conv2d:[51,52,65],conv3:51,conv4_x:53,conv5_x:53,conv:65,conveni:[53,67],convers:[51,53,55,57,64,65],conversionctx:[60,65],convert:[3,4,33,36,37,52,53,55,56,58,61,64,70],convert_method_to_trt_engin:[64,70],convertgraphtotrtengin:[21,38,44,48,49,65],convien:45,convienc:[3,4],convolut:[53,67,71],coordin:58,copi:[43,51,52,53,60],copyright:[41,42,43,44,51,52,53,65],core:[44,51,52,53,55,58,64,65,71],corpor:[41,42,43,44,51,52,53],correct:66,correspond:[51,53,60],cos:62,cosh:62,count_include_pad:62,coupl:[51,52,54,58,68],cout:65,cp36:66,cp36m:66,cp37:66,cp37m:66,cp38:66,cp39:66,cpp:[14,15,16,41,42,43,44,50,55,58,65,67],cpp_frontend:67,cppdirectori:[22,48],cppdoc:65,creat:[30,31,51,52,53,54,57,60,64,69],credit:65,csrc:[55,59],cstddef:67,ctx:[60,65],ctype:65,cu102:66,cuda:[45,51,52,53,57,64,65,66,67,70],cuda_runtim:[21,44],cudafloattyp:65,cudasetdevic:34,cudnn8:66,cudnn:[51,52,53],cudnn_en:62,curl:66,current:[23,60],custom:66,cxx11:68,cycler:51,d17fnq9dkz9hgj:51,data:[1,3,4,30,31,43,44,45,46,51,52,53,54,56,58,60,67],data_dir:67,dataflow:[60,65],dataload:[4,30,31,43,45,67],dataloader_:43,dataloadercalibr:67,dataloaderopt:67,dataloaderuniqueptr:[4,43],dataset:[31,53,67],datatyp:[0,2,21,38,44,45,46,48,49,64],dateutil:51,dbg:66,dead_code_elimin:55,deal:60,debug:[17,26,44,45,60,63,64,69,70],debugg:[64,69],decid:52,decod:51,decode_result:53,deconvolut:71,dedic:55,deep:[51,52,53,60,61,67,71],deeplearn:59,deeplearningexampl:53,def:[51,52,53,65],defin:[1,2,3,4,17,23,24,25,26,27,28,29,30,31,32,33,34,35,36,37,42,45,46,47,50,51,52,65,67,69],definit:[50,60],delet:[1,2,44,45,46,55],demo:[51,53,67],demonstr:[51,52,53,67],denorm:53,dep:66,depend:[31,32,51,53,54,58,65,68],depickl:57,deploi:[51,52,61,65,67],deploy:[51,52,65,67,68,69,71],deprec:62,describ:[45,51,52,53,60,64,65,70],deseri:[64,65],design:[51,52,71],desir:67,destroi:60,destructor:60,detail:[51,65,68],detect:[51,57],detections_batch:53,determin:55,determinist:62,develop:[51,52,61,65,66],deviat:69,devic:[0,21,34,38,44,45,48,49,51,52,64,65,67,69,70,71],device_typ:[44,45,46,64,67,70,71],deviceclass:[0,48],devicetyp:[21,38,44,45,46,48,49,64,67,70,71],devicetypestruct:[0,48],dict:[53,64],dictionari:[64,65,70],differ:[31,52,53,55,58,61,65],differenti:[51,52],dilat:[51,62],dim0:62,dim1:62,dim:[51,62],dim_int:62,dim_intlist:62,dimens:55,directli:[60,61,67],directori:[18,19,20,21,22,41,42,43,44,48,51,66,67],disabl:[63,66,69],disable_tf32:[44,45,64,67],disclos:66,disp:51,displai:69,dist:[51,66],distdir:66,distribut:[51,52,53,64,65,67,68],div:62,div_:62,divisor_overrid:62,dl_open:68,dla:[2,44,45,46,61,64,69],dla_cor:[44,45,46,64,67,70,71],doc:[58,59,66],docker:[51,52,53],docsrc:58,document:[41,42,43,44,48,49,58,65,67,68,70],doe:[42,43,51,53,55,60,67],doesn:65,doing:[53,54,55,65,67],domain:67,don:[52,60,67],done:[51,53,54,58],dont:41,down:[51,52,66],download:[53,66,67],downsampl:51,doxygen_should_skip_thi:[43,44],driver:[51,66],drop:[53,66],dtype:[51,52,53,62,64],due:[3,4,51,53],dump:[35,66,69],dump_build_info:[21,38,44,48,49,64],dure:[60,67,69],dynam:[45,47,64],each:[3,4,45,53,54,55,57,60,64,65],eager:[51,52],earlier:51,easi:[54,55,65,67,69],easier:[56,58,60,65,67],easiest:66,easili:[3,4],ecc:51,ecosystem:[51,52,53],edgecolor:53,edu:67,effect:[55,65,67],effici:60,either:[45,47,51,52,53,60,64,65,66,69],element:57,element_typ:43,els:[42,43,64],elu:62,emb:65,embed:[57,62,65,69,71],emit:54,empti:[52,65],emum:[17,45],enabl:[3,4,25,51,52,53,63,64],encount:66,end:[43,60,62,65,67],end_dim:[62,65],end_tim:[51,52,53],endif:[42,43,44],enforc:65,engin:[1,2,33,37,45,46,47,54,56,58,61,64,65,67,69,70,71],engine_converted_from_jit:65,enginecap:[44,45,64,70],enhanc:53,ensur:[31,55],enter:54,entri:[45,60,64],entropi:[30,31,67],entropy_calibration_2:67,enumer:[1,2,17,45,46],eps:[51,62],equival:[33,51,52,53,56,58,60,64,65,67],equivil:37,erf:62,error:[17,54,55,58,63,65,66],etc:[64,71],eval:[51,52,53,65],evalu:[53,56,57,58],evaluated_value_map:[54,60],even:65,everi:65,everyth:17,exactli:53,exampl:[51,52,53,57,58,60,65,67],except:[51,52,53],exception_elimin:55,execpt:55,execut:[51,52,53,55,56,57,58,64,65,67],execute_engin:[57,65],exeuct:57,exhaust:65,exist:[4,33,36,37,51,64,66,67],exp:62,expand:[55,62],expand_a:62,expect:[51,55,60,65],experi:[51,52],explic:43,explicit:[3,4,44,55,61,67],explicitli:[67,70],explict:43,explictli:[1,45],expon:62,expos:67,express:[51,52,53],extend:[56,58,60,65],extent:[61,65],extra:[45,65],extract:65,extractor:52,f16:[65,69,71],f32:69,facecolor:53,factori:[4,30,31,67],fail:[65,71],fallback:[60,69,71],fals:[1,2,3,4,43,44,45,46,51,53,62,64,65,67,70],famili:[51,52,53],familyhandyman:51,fan:51,fashion:65,fbed:51,fc1:[52,65],fc2:[52,65],fc3:[52,65],feat:[52,65],featur:[51,52,53,65,67,69,70],fed:[3,4],feed:[30,31,65],feel:61,few:[51,52],field:[3,4,67],fig:[51,53],file:[1,2,3,4,5,6,7,8,9,10,11,12,17,23,24,25,26,27,28,29,30,31,32,33,34,35,36,37,45,46,47,51,52,53,57,58,64,65,66,67,69],file_path:69,filer_publ:51,filer_public_thumbnail:51,fill:[51,52],filter:53,find:[4,53,65],finish:53,first:[51,52,53,54,55,65,67],five:53,fix:[45,51,53,71],fixed_s:[44,45],flag:[66,69],flatten:[52,62,65],flatten_convert:65,flexibl:[51,52,53],float16:[64,69],float32:[45,51,64,69],float_int:62,floor:62,floor_divid:62,floordiv:62,flow:[51,52,53,60,65],fly:65,follow:[51,52,53,65,66,67,69],footprint:[51,52],forc:[64,69],form:54,format:[45,51,52,53,64,69],forum:66,forward:[30,31,33,52,57,60,64,65,67,70],found:[41,42,43,44,51,53,65,66,67],fp16:[1,45,52,53,61,64,65,71],fp32:[1,45,52,53,61,64,67],framework:[51,52,53],freed:60,freez:65,freeze_modul:55,from:[1,2,3,4,30,31,43,45,46,47,51,52,53,54,55,56,57,58,60,61,65,67,69],fssl:66,fstream:[20,43],full:[60,65,67,68,69,71],fulli:[36,55,64,65,67,71],fuse:[51,52],fuse_addmm_branch:55,fuse_flatten_linear:55,fuse_linear:55,fusion:60,futur:[51,52],gain:53,gamma:62,gaurd:42,gcc:[58,65],gear:67,gener:[3,4,31,51,52,53,55,57,58,60,65,67,69],get:[1,2,3,4,23,32,43,45,46,47,53,55,60,63,66,67,70],get_batch_impl:43,get_build_info:[21,38,44,48,49,64],get_coco_object_dictionari:53,get_is_colored_output_on:[18,39,41,48,49,63],get_logging_prefix:[18,39,41,48,49,63],get_reportable_log_level:[18,39,41,48,49,63],getattr:[55,57,65],getbatch:[3,4,43],getbatchs:[3,4,43],getdimens:[60,65],getoutput:[60,65],github:[51,52,53,59,65,66,67],give:52,given:[45,51,53,55,64,65,69,70],global:[27,65],gnu:66,goal:60,going:[43,65],good:[43,60],got:65,govern:[51,52,53],gpu:[2,33,34,37,44,45,46,51,52,64,65,67,69,70,71],gpu_id:[34,44,45,46,64,67,70,71],granular:52,graph:[17,33,36,37,44,51,52,53,54,56,58,60,61,64,65],great:[51,52,53,65],green_mamba:51,group:62,gtc:61,guard:55,guard_elimin:55,gulf:51,hack:43,hakaimagazin:51,half:[52,53,64,65,69,70,71],handl:[53,55,57],happen:[51,52,65],hardtanh:[60,62],hardtanh_:62,hardwar:[51,52,53,71],has:[51,52,53,54,55,58,60,65,67],hash:66,have:[31,43,51,52,53,54,55,60,61,65,66,67,69],haven:65,head:53,header:[51,65],help:[26,51,52,54,60,65,69],helper:[51,52,53,60],here:[43,51,52,53,54,57,65,66,67],hermet:66,hfile:[22,48],hidden:42,high:[51,53,55,65],higher:[55,65],hinton:67,hold:[45,46,47,54,60,67],holder:57,home:66,hood:58,host:66,how:[3,4,51,53,65,70],howev:[31,51,52,53,66],html:[59,65,66,67],http:[51,52,53,59,65,66,67],http_archiv:66,hub:[51,53],huski:51,idea:55,ident:69,idx:[53,62],ifndef:[43,44],ifstream:43,iint8calibr:[3,4,30,31,43,44,45,67],iint8entropycalibrator2:[3,4,30,31,43,67],iint8minmaxcalibr:[30,31,67],ilay:60,imag:[51,53,67],image_idx:53,imagenet:51,imagenet_cla:51,imagenet_class_index:51,images_:67,img0:51,img1:51,img2:51,img3:51,img:51,img_path:51,impact:[51,52,53],implement:[3,4,51,52,53,55,57,65,67],impli:[51,52,53],implic:55,implicit:62,imshow:[51,53],in_featur:[51,52],in_shap:65,in_tensor:65,incas:43,includ:[14,16,17,32,35,41,42,43,44,50,51,52,53,64,65,66,67,69],includedirectori:[22,48],ind:51,independ:[51,53],index:[59,61,62,67],indic:62,inetworkdefinit:54,infer:[51,52,55,65,67],info:[17,33,37,44,45,60,63,65,69],inform:[28,32,35,53,54,61,64,65,67,69,70],infrastructur:67,ingest:58,inherit:[48,49,67],inlin:[43,55,65],inner:45,inplac:51,input0:65,input1:65,input2:65,input:[3,4,31,43,45,47,51,52,53,54,55,57,60,62,64,65,67,69,70,71],input_0:[57,65],input_batch:51,input_data:[51,52,53,65],input_file_path:[69,71],input_rang:[44,45],input_s:65,input_scal:62,input_shap:[51,52,53,64,65,67,69,70,71],input_tensor:51,inputrang:[21,38,44,45,48,49,65],inputrangeclass:[0,48],inspect:[52,60,65],instal:[51,53,61,65,68],instanc:[51,52,55,65],instanti:[56,57,58,60,65],instatin:[1,2,45,46],instead:[54,55,65,68,69],instnanti:57,instruct:[65,66],insur:66,int16_t:44,int64_t:[44,45,46,47,67,71],int8:[1,43,45,61,64,67,69,71],int8_t:44,int8cachecalibr:[20,31,40,43,48,49],int8cachecalibratortempl:[0,48],int8calibr:[3,20,30,40,43,48,49],int8calibratorstruct:[0,48],int_float:62,integ:64,integr:[51,52,61],intent:55,intercompat:[51,53],interest:55,interfac:[1,2,45,46,57,58,60,65,67],intermedi:[17,51,52,65],intern:[2,17,45,46,51,52,53,60,65],internal_error:63,internalerror:63,interpret:[51,52,57],intro_to_torchscript_tutori:65,introduc:[51,52,53],invok:65,involv:[51,52],ios:43,iostream:[20,43,65],is_avail:51,is_train:67,iscustomclass:60,issu:[3,4,51,52,65,66],istensor:60,istream_iter:43,it_:43,item:51,itensor:[54,60,65],iter:[20,43,45,51,52,53,54,64,69],its:[31,51,52,53,54,57,60],itself:[1,2,45,46,55,66,69,70],ivalu:[54,57,60,65],jetson:[51,52,64],jit:[33,36,37,44,51,52,53,54,55,56,57,58,59,60,64,65,69,70],jpeg:51,jpg:[51,53],jpg__1920x1080_q85_subject_loc:51,json:51,json_fil:51,just:[43,44,51,53,55,61,65,68,70],kchar:[1,44,45],kclip:60,kcpu:[2,45,46],kcuda:[2,45,46,65],kdebug:[17,41,43],kdefault:[44,45],kdla:[2,44,45,46,71],keepdim:62,kei:[64,65],kernel:[45,51,52,60,64,65,69],kernel_s:[51,52,62],kerror:[17,41],kf16:71,kfloat:[1,44,45],kgpu:[2,44,45,46],kgraph:[17,41,55],khalf:[1,44,45,65],ki8:67,kind:[51,52,53,54,64],kinfo:[17,41,43],kinternal_error:[17,41],kiwisolv:51,know:[41,60],known:53,kriz:67,krizhevski:67,ksafe_dla:[44,45],ksafe_gpu:[44,45],ktest:67,ktrain:67,kwarn:[17,41],label:[53,67],laid:65,lambda:[60,65],languag:[51,52,53,65],larg:[51,52,56,58,65,67],larger:67,largest:62,last:[53,55],later:[31,65],latest:66,law:[51,52,53],layer1:51,layer2:51,layer3:51,layer4:51,layer:[45,46,51,52,53,54,55,60,64,65,67,69,71],ld_library_path:66,ld_preload:68,ldd:66,leaky_relu:62,leaky_relu_:62,learn:[61,65,66,67,71],least:51,leav:[52,55],left:53,len:[51,53,62],lenet:[53,65],lenet_script:65,lenetclassifi:[52,65],lenetfeatextractor:[52,65],length:[3,4,43,51,62],let:[45,46,51,52,53,55,60,69],level:[18,23,27,28,39,41,43,48,49,51,52,55,58,63,65],levelnamespac:[0,48],leverag:[51,52,53,67],lib:[51,55,65,66],librari:[32,41,42,43,44,51,52,53,56,57,58,60,65],libtorch:[4,35,51,52,53,60,65,66,67],libtorch_pre_cxx11_abi:66,libtrtorch:[65,66,69],libtrtorchrt:68,licens:[41,42,43,44,51,52,53,65],like:[51,52,53,54,55,57,60,65,66,67,68,69],limit:[51,52,53,55,67],line:[65,69],linear:[51,52,62,65],linewidth:53,link:[54,61,65,68,69],linux:[58,65,66],linux_x86_64:66,list:[18,19,20,21,36,50,53,54,57,60,62,64,65,66],listconstruct:[54,57,65],listunpack:[57,65],live:60,load:[51,53,57,65,66,67,68,69,70],load_librari:68,loader:[51,52,53],loading_data_recip:67,local:[51,53,55,65],locat:[53,67],log:[16,17,19,20,22,38,43,48,49,50,55,60,62,64],log_debug:60,logger:63,loggingenum:[0,48],loglevel:63,longer:[51,52,68],look:[54,55,65,67,70],loop_unrol:55,lorikeet:51,loss:67,lot:60,lower:17,lower_graph:55,lower_tupl:55,loweralltupl:55,lowersimpletupl:55,lstm_cell:62,lvl:[27,28,41],machin:[51,52,57,66,67],macro:[5,6,7,8,9,10,11,12,16,18,21,22,41,44,48,50],made:[53,55,56,58],mai:[51,52,53,54,57,58,65,67],main:[53,55,56,57,58,60,65],maintain:[57,60],major:[51,52,53,58],make:[51,52,53,54,65,66,67,71],make_data_load:[4,67],make_int8_cache_calibr:[20,40,43,48,49,67],make_int8_calibr:[20,31,40,43,48,49,67],manag:[54,56,58,60,65],mangag:55,mantissa:[45,64],manual:66,map:[2,45,46,54,55,56,58,60,65,67,70],master:[59,66,67],match:[45,55,66],matmul:[55,62,65],matplotlib:[51,53],matrix:59,matur:58,max:[44,45,47,52,60,62,64,65,69],max_batch_s:[44,45,64,67,69,70],max_c:69,max_h:69,max_n:69,max_pool1d:62,max_pool2d:[52,62,65],max_pool3d:62,max_val:[60,62],max_w:69,maximum:[45,47,64,65,69],maxpool2d:51,maxpool:51,mean:[45,51,52,53,60,61,62,64,65,69],mechan:60,media:51,meet:64,member:[45,46,47,64],memori:[20,21,43,44,51,52,55,60,65],mention:51,menu:69,messag:[17,27,28,63,69],metadata:[57,60],method:[33,36,37,51,52,53,55,60,64,65,66,70],method_nam:[36,37,44,64,65],mig:51,might:55,min:[44,45,47,52,60,62,64,65,69],min_c:69,min_h:69,min_n:69,min_val:[60,62],min_w:69,mini:51,minim:[45,64,67,69],minimum:[45,47,63,65],minmax:[30,31,67],miss:65,mix:53,mkdir:[51,66],mobilenet_v2:70,mod:[65,67],mode:[65,67],mode_:67,model:[57,65,67,70],model_math:53,modern:53,modifi:66,modul:[33,36,37,44,51,52,53,56,57,58,60,61,64,67,69,70,71],modular:65,momentum:[51,62],more:[51,52,53,54,61,65,67,68,70],most:58,move:[30,43,44,51,52,55,57,65,67],msg:[27,41,63],much:[60,67],mul:62,mul_:62,multipl:[57,67],multipli:[45,64],must:[45,51,53,60,64,65,66,68,69],n01749939:51,n01820546:51,n02110185:51,n02481823:51,name:[3,4,36,37,43,51,53,57,60,64,65,66,70],namespac:[0,41,43,44,50,55,61,67],nano:66,narrow:62,nativ:[58,59,65],native_funct:59,nbbind:[3,4,43],ncol:51,necessari:[41,68],need:[1,2,28,31,42,45,46,53,54,55,60,65,66,67,68],neg:62,negative_slop:62,nest:[48,49],net:[51,60,65],network:[30,31,51,52,53,60,65,67,71],neural:[51,53,71],new_lay:60,new_local_repositori:66,new_siz:67,newer:[51,52],next:[3,4,53,54,57,67],ngc:53,nice:66,ninja:66,nlp:[30,31,67],no_grad:[51,52,53],node:[55,60,65],node_info:[60,65],noexcept:67,none:[53,60,62],normal:[1,2,45,46,51,52,53,65,67,71],noskipw:43,note:[2,45,46,51,60,65,66,71],notebook:[51,52,53,58],notic:[52,53],now:[51,52,53,55,58,60,65,66,70],nrow:51,nrun:[51,52,53],nullptr:[43,44,45],num:69,num_avg_timing_it:[44,45,64,70],num_it:69,num_min_timing_it:[44,45,64,70],num_work:67,number:[3,4,45,51,55,60,64,65,69],numel:62,numer:69,numpi:[51,52,53],nvidia:[33,37,41,42,43,44,51,52,53,59,64,65,66,67,69,71],nvidia_deeplearningexamples_torchhub:53,nvidia_ncf:53,nvidia_ssd:53,nvidia_ssd_processing_util:53,nvidia_tacotron2:53,nvidia_waveglow:53,nvinfer1:[3,4,30,31,43,44,45,60,67],nvinfer:[20,43],nwarmup:[51,52,53],obj:62,object:[1,2,3,4,45,46,47,60,64,65,67,70],observ:51,obsolet:53,obtain:[51,52,53],obvious:65,octet:51,off:[51,53,57],offici:66,ofstream:[43,65],older:58,olefil:51,onc:[41,42,43,44,54,55,57,65,67,68],one:[53,55,60,63,65],ones:[41,51,52,53,65,66],onli:[2,3,4,17,31,43,45,46,52,53,55,58,60,63,64,65,66,67,68,69,71],onnx:55,onto:[57,69],op_precis:[44,45,51,52,53,64,65,67,69,70,71],open:[51,52],oper:[1,2,3,4,36,43,44,45,46,51,52,54,55,56,57,58,60,61,64,67,69,71],ops:[51,53,55,65,68],opset:[56,58],opt:[44,45,47,52,64,65,66],opt_c:69,opt_h:69,opt_n:69,opt_w:69,optim:[45,47,51,52,53,55,61,65,69],optimi:65,optimin:[45,47],optimiz:[51,52,53],option:[43,64,66,67,68,69,71],order:[45,53,60,65],org:[51,52,53,59,65,66,67],origin:53,original_nam:52,other:[1,2,44,45,46,51,52,53,54,55,57,61,62,64,65,66,68,69],otherwis:[66,68],our:[51,52,53,58,65],out:[36,43,51,52,54,55,56,58,60,63,64,65,66],out_featur:[51,52],out_shap:65,out_tensor:[60,65],output0:55,output:[25,26,45,51,52,53,54,55,57,60,63,65,66,69],output_file_path:[69,71],output_pad:62,output_s:[51,62],outself:65,over:[51,52,56,58],overkil:52,overrid:[3,4,30,31,43,67],overview:[59,61],own:[51,52,60,65],p100:51,packag:[51,55,65,69],pad:[51,62],padding_idx:62,page:61,pair:[60,67],paper:[51,53],paramet:[1,2,3,4,26,27,28,30,31,33,34,36,37,45,46,47,54,55,60,63,64,65],parent:[14,15,16,18,19,20,21],pars:65,part:[58,69],particular:52,pass:[54,56,57,58,60,65,67],patch:53,path:[4,13,14,15,16,30,31,51,52,53,65,66,67,69],path_to_trtorch_root:66,pathwai:65,pattern:[60,65],peephole_optimz:55,per:53,perf:51,perform:[30,31,51,52,53,67],performac:[45,47,67],permiss:[51,52,53],permut:62,persist:51,phase:[17,60,65],pick:[52,65],pick_best:53,pickler:57,pid:51,pil:51,pillow:[51,53],pip3:66,pip3_import:66,pip:[51,53,66],pip_instal:66,pipelin:[65,69,71],piplein:65,place:[55,66,67],plan:[58,69],platform:[44,51,52,58,66,71],pleas:66,plot:53,plot_result:53,plt:[51,53],point:[64,65],pointer:[3,4,67],pool:71,pop:57,portabl:[51,52,53,57],posit:69,possibl:[51,52],post:[30,31,45,61,65,69],pow:62,power:[51,52,65],practic:[51,52],pragma:[41,42,43,44,67],pre:[51,67,68],pre_cxx11_abi:66,precis:[45,52,53,61,64,65,67,69,71],pred:51,pred_label:53,pred_loc:53,predict:[51,53],prefer:65,prefix:[24,26,41,63],prelu:62,prepar:[51,52,53],prepare_input:53,prepare_tensor:53,preprint:67,preprocess:[51,67],preserv:[65,67],prespect:65,pretrain:[51,53,70],pretti:65,prevent:45,previous:[31,65],prim:[54,55,57,62,65],primarili:[58,65],primer:53,print:[17,36,43,51,52,53,63,64,65,70],priorit:66,privat:[3,4,43,44,67],prob:51,probabl:[51,53],probablil:51,process:[51,52,53,65,67,69,70],prod:62,produc:[45,47,54,57,60,65],product:[45,51,52],profil:[45,47],program:[18,19,20,21,31,50,51,52,53,56,58,61,65,69],propog:55,provid:[3,4,45,57,60,64,65,66,67,70],providi:[56,58],ptq:[3,4,16,18,22,38,48,49,50,61,69],ptq_calibr:[3,4,44,45,67],ptqtemplat:[0,48],pull:66,pure:36,purpos:[51,53,66],push:57,push_back:43,pwr:51,py_test_dep:66,pypars:51,pyplot:[51,53],python3:[51,55,65,66],python:[51,52,53,58,68,69,71],python_api:59,pytorch:[51,53,56,57,58,60,64,65,66,67,68],pytorch_vision_v0:51,qualiti:[51,53],quantiz:[30,31,61,65,69],quantizatiom:45,question:65,quickli:[65,67,69],quit:[60,65],rais:55,raiseexcept:55,rand:65,randn:[51,52,53,65,70],rang:[45,47,51,52,53,64,65,69],rather:55,raw:53,read:[3,4,30,31,43,67],readcalibrationcach:[3,4,43],readm:[51,52,53],realiz:57,realli:60,reason:[1,45,53,65],recalibr:31,recip:67,recipi:53,reciproc:62,recognit:[51,67],recomend:[30,31],recommend:[30,31,65,66],recompil:53,record:[51,52,54,65],rect:53,rectangl:53,recurs:54,recursivescriptmodul:52,reduc:[51,52,55,56,58,67],refer:[56,58,67],referenc:[53,66],refit:[44,45,64,70],reflect:44,regard:66,regist:[57,60],registernodeconversionpattern:[60,65],registri:[54,65],reinterpret_cast:43,relat:[45,46],relationship:[48,49],relu:[51,52,62,65],relu_:62,remain:[51,52,53,55,67],remov:[51,53],remove_contigu:55,remove_dropout:55,remove_to:55,repack:57,repeat:62,replac:[53,55],report:[23,43],reportable_log_level:63,repositori:[51,53,58],repres:[45,47,60,63],represent:[51,52,55,60,65],request:[51,65],requir:[31,51,52,53,54,55,63,64,65,66,67,68,69],research:[51,52],reserv:[41,42,43,44,51,52,53],reset:43,reshap:62,residu:51,resiz:51,resnet50:51,resnet50_model:51,resnet:[53,57],resnet_50_trac:51,resnet_trt:57,resolv:[51,54,55,56,58],resourc:[54,67],respons:[31,51,57],restrict:[45,64,69],result:[51,52,54,55,64,65],results_per_input:53,ret:55,reus:[55,67],rgb:51,right:[41,42,43,44,51,52,53,55,58,60],rn50_preprocess:51,root:[41,42,43,44,51,53,66,67],round:[45,64],rsub:62,rule:66,run:[2,37,45,46,51,52,53,54,55,56,57,58,60,61,64,65,66,67,68,69,70,71],runtim:[51,52,53,61,65],safe:[60,64],safe_dla:[64,69],safe_gpu:[64,69],safeti:[45,64],same:[51,53,57,65,66,70],sampl:[51,67],satisfi:51,save:[31,43,51,52,53,57,64,68,69],saw:65,scalar:[60,62],scalartyp:[1,44,45],scale:[62,67],scale_factor:62,scale_grad_by_freq:62,scales_d:62,scales_h:62,scales_w:62,schema:[60,65],scikit:53,scipi:53,scope:55,score:[51,53],scratch:31,script:[36,51,53,55,64,65,70],script_model:[52,65,70],scriptclass:64,scripted_model:71,scriptmodul:[64,65],sdk:[51,52,53,59],seamlessli:61,search:61,section:67,secur:66,see:[36,51,52,53,55,57,64,65],select:[30,31,37,45,51,52,62,64,67,69],self:[52,55,57,60,62,65,71],self_1:[57,65],self_int:62,sens:65,sent:51,separ:[51,52,53],sequenti:51,serial:[37,56,58,64,65],serializ:57,seril:57,serv:[57,69],set:[3,4,17,26,28,31,33,34,37,44,45,46,47,51,52,53,54,55,56,57,58,61,63,64,65,66,67,69,71],set_devic:[21,38,44,48,49,64],set_is_colored_output_on:[18,39,41,48,49,63],set_logging_prefix:[18,39,41,48,49,63],set_reportable_log_level:[18,39,41,48,49,63],setalpha:60,setbeta:60,setnam:[60,65],setreshapedimens:65,setup:67,sever:[17,27,63],sha256:66,shape:[45,47,51,52,53,60,62,64,71],share:66,ship:[65,68],should:[1,3,4,31,44,45,51,54,60,61,63,64,67,69],show:[51,53],shown:65,shuffl:[65,67],shutterstock_780480850:51,siberian:51,siberian_huski:51,side:[55,65],sigmoid:62,sigmoid_:62,signifi:[45,47],signific:53,significantli:55,similar:[53,60,65,70],simonyan:67,simpil:67,simpl:[52,65],simpli:[52,55],simplic:[51,53],simplifi:54,sin:62,sinc:[52,55,65,67],singl:[45,47,52,55,65,67,69],singular:60,sinh:62,site:[55,65,66],six:51,size:[3,4,43,45,47,51,52,53,55,62,64,65,67,69,71],size_t:[3,4,43,67],slice:62,slither:51,sm_output:51,small:55,smi:51,snake:51,softmax:[51,53,55,62],softwar:[51,52,53],sole:67,some:[54,55,56,57,58,60,65,67],someth:[42,55],sort:[60,62,70],sourc:[41,42,43,44,51,53,58,64],space:67,spars:62,spec:[64,70],specif:[33,51,52,53,55,56,58,64],specifi:[3,4,51,53,60,61,63,64,65,69,70],specifii:64,speed:[51,53],speedup:51,split:62,split_siz:62,split_with_s:62,sqrt:62,squeez:62,src:[57,59],ssd300:53,ssd300_trt:57,ssd:57,ssd_300_trace:53,ssd_trace:69,ssd_trt:69,sstream:[20,43],stabl:59,stack:[57,62,67],stage:54,stand:57,standard:[51,52,53,61,68,69,70],start:[53,54,62,66,70],start_dim:[62,65],start_tim:[51,52,53],state:[54,60,65],statement:55,static_cast:43,statu:43,std:[3,4,24,27,29,30,31,32,36,37,41,43,44,45,47,51,65,67,71],stdout:[35,63,64],steamlin:67,step:[51,52,53,61,62,67],still:[43,51,53,67],stitch:[52,65],stop:65,storag:67,store:[4,54,57,60,65],str:[19,42,43,48,49,51,63,64],straight:60,stream:51,strict:[68,69],strict_typ:[44,45,64,70],strictli:64,stride:[51,52,53,62],string:[3,4,18,20,21,24,27,29,30,31,32,36,37,41,43,44,60,64,65,67],stringstream:43,strip_prefix:66,strong:[51,52],struct:[1,2,21,38,44,67],structur:[31,44,45,46,51,52,58,60,65],style:[41,42,43,44],sub:[62,65],sub_:62,subdirectori:50,subexpress:55,subgraph:[54,55,60,65],subject:58,submodul:[52,65],subplot:[51,53],subset:67,successfulli:[51,53],sudo:66,suffic:55,suggest:53,suit:61,sum:[45,62,64],support:[1,2,26,36,45,46,47,51,52,53,59,61,64,65,66,69,71],sure:[65,66,71],sxm2:51,symbol:66,synchron:[51,52,53],system:[51,53,54,60,61,66],take:[33,36,37,51,52,53,54,56,57,58,60,64,65,67,70],taken:[51,53],talk:61,tan:62,tanh:62,tanh_:62,tar:[66,67],tarbal:[65,67],target:[2,44,45,46,51,52,53,58,61,64,65,67,69,70,71],targets_:67,task:[30,31,67],techinqu:65,techniqu:67,tell:60,temp:51,templat:[20,40,43,44,48,49,65],tensor:[43,45,47,51,52,53,54,55,57,60,62,65,67],tensor_scalar:62,tensor_tensor:62,tensorcontain:60,tensorlist:60,tensorrt:[1,2,3,4,30,31,33,35,37,44,45,46,47,51,52,53,54,55,56,58,60,61,64,65,67,69,70],tensorrtcompilespec:[64,70],term:67,termin:[26,65,69],tesla:51,test:[51,52,53,58,66,67,69],test_ptq_dataloader_calibr:67,test_ptq_trt_calibr:67,testing_dataload:67,testing_dataset:67,text:[53,63],tf32:45,tgz:66,than:[55,61,66,68],thats:[54,67],thei:[45,46,53,54,55,60,66,69],them:[51,52,53,57,65,66],theori:54,therebi:57,therefor:[31,65],therfor:68,thi:[1,2,30,31,41,42,43,44,45,46,47,51,52,53,54,55,56,57,58,60,65,66,67,68,69,70],thing:52,think:60,third_parti:[58,66],those:54,though:[51,53,58,60,65,69],three:[45,47,56,58],threshold:69,thrid_parti:66,through:[51,52,53,54,55,57,61,65],time:[45,51,52,53,54,55,56,58,60,64,65,67,69],tini:67,titan:[51,52],titl:51,tmp:65,tocustomclass:60,todim:65,togeth:[52,54,60,65],toilet:51,too:66,tool:[51,52,60,65],toolchain:58,top:[53,58],topk:62,torch:[1,2,4,20,30,31,33,36,37,43,44,45,46,51,52,53,55,57,59,60,64,65,66,67,68,69,70,71],torch_scirpt_modul:65,torch_script_modul:65,torchbind:57,torchhub:53,torchscript:[33,36,37,51,53,56,57,58,64,69,70,71],torchvis:[51,57,67,70],toronto:67,totensor:[51,67],tovec:65,toward:67,trace:[53,64,65],traced_model:[51,52,53,65],track:[60,67],track_running_stat:51,trade:53,tradit:[64,67],traget:33,train:[30,31,45,51,53,61,62,65,69],trainabl:55,transform:[51,52,65,67],translat:[53,65],transpos:62,travers:[56,58],treat:69,tree:[41,42,43,44,67],trigger:[52,65],trim:67,trt:[1,2,3,4,45,46,54,55,57,60,62,65],trt_lenet_script:65,trt_mod:[65,67,71],trt_model:[51,53,70],trt_model_fp32:51,trt_script_modul:52,trt_ts_modul:[52,65],trtorch:[0,1,2,3,4,15,17,22,41,42,43,45,46,47,49,50,54,55,56,57,58,66,67,69,71],trtorch_api:[19,23,24,25,26,27,28,29,30,31,32,33,34,35,36,37,41,42,43,44,48,49],trtorch_check:60,trtorch_hidden:[19,42,48,49],trtorch_major_vers:[19,42,48,49],trtorch_minor_vers:[19,42,48,49],trtorch_patch_vers:[19,42,48,49],trtorch_py_dep:66,trtorch_unus:60,trtorch_vers:[19,42,48,49],trtorchc:[61,71],trtorchfil:[22,48],trtorchnamespac:[0,48],ts_model:65,tue:51,tune:[51,52,53],tupl:[57,64,65],tupleconstruct:[55,57],tupleunpack:55,tutori:[65,67],two:[51,52,53,60,65,66,67,69],txt:66,type:[1,2,30,47,48,49,51,54,57,60,63,64,65,67,69],typenam:[3,4,30,31,43],typic:[54,60],ubuntu:66,uint64_t:[44,45],unabl:[60,65],uncom:66,uncorr:51,under:[41,42,43,44,51,52,53,58],underli:[1,2,45,46,60],understand:65,union:[60,65],uniqu:4,unique_ptr:[4,30],unit:52,unless:[51,52,53],unlik:[61,65,66,70],unpack_addmm:55,unpack_log_softmax:55,unqiue_ptr:4,unsqueez:[51,62],unstabl:58,unsupport:[36,64],unsur:60,untest:58,until:[54,58,60,66],unwrap:60,unwrap_distribut:53,unwraptodoubl:60,unwraptoint:65,unzip:66,upgrad:51,upload:51,upsample_bilinear2d:62,upsample_linear1d:62,upsample_nearest1d:62,upsample_nearest2d:62,upsample_nearest3d:62,upsample_trilinear3d:62,upstream:65,uri:53,url:66,usag:[51,65],use:[1,2,3,4,30,31,45,46,51,52,53,54,55,57,58,60,63,64,65,66,67,68,69,70],use_cach:[3,4,30,43,67],use_cache_:43,use_subset:67,usecas:66,used:[1,2,3,4,43,45,46,47,51,53,54,55,57,60,63,64,65,67,69],useful:60,user:[41,51,52,56,57,58,65,66,67],uses:[30,31,43,51,52,53,60,66,67],using:[1,2,33,34,37,43,44,45,46,51,52,53,60,61,64,65,67,68,69,70],using_int:[62,65],usr:[51,66],usual:53,util:[60,64,65,67],val2017:53,val:53,valid:[2,45,46,53,60],valu:[1,2,17,44,45,46,54,57,60,62,63,65],value_tensor_map:[54,60],variant:68,varient:55,variou:71,vec:62,vector:[20,21,43,44,45,47,65,67,71],verbios:69,verbos:69,veri:[67,70],version:[32,35,51,52,53,58,66],vgg16:67,vgg:[53,67],via:[51,53,61,64,67,68],view:62,virtual:67,vision:51,visit:53,volatil:51,volta:[51,52],w_hh:62,w_ih:62,wai:[51,65,66,67,69],walk:[51,52,53],want:[41,45,51,52,65,67,70],warm:[51,52,53],warn:[17,43,51,60,63,69],warranti:[51,52,53],websit:66,weight:[54,62,65],welcom:65,well:[51,52,53,65,67],were:[53,65],wget:51,what:[4,53,55,65],whatev:57,when:[26,43,44,45,46,51,52,54,55,56,57,58,60,63,64,65,66,67,69],where:[51,52,54,55,60,65,67],whether:[4,67],which:[2,31,33,37,45,46,51,52,53,54,55,56,57,58,60,64,65,67,70],whilst:53,white:53,whl:66,whole:[51,52],whose:55,width:51,within:[51,52,53,56,58],without:[51,52,53,60,65,67],work:[43,52,53,55,58,60,67],worker:67,workflow:70,workspac:[45,64,66,67,69,71],workspace_s:[44,45,51,53,64,67,69,71],world:[51,52],would:[60,65,66,68,69,70],wrap:[56,57,58,65,70],wrapper:60,write:[3,4,30,31,43,51,52,53,54,61,65,67],writecalibrationcach:[3,4,43],www:[51,52,53,65,66,67],x64:66,x86:68,x86_64:[58,66],xavier:[44,51,52,64,71],xstr:[19,42,48,49],yaml:59,you:[1,2,30,31,45,46,51,52,53,54,55,57,58,60,61,64,65,66,67,68,69,70],your:[51,52,53,60,61,65,66,68,70],yourself:65,zip:[57,66],zisserman:67},titles:["Class Hierarchy","Class CompileSpec::DataType","Class Device::DeviceType","Template Class Int8CacheCalibrator","Template Class Int8Calibrator","Define STR","Define TRTORCH_API","Define TRTORCH_HIDDEN","Define TRTORCH_MAJOR_VERSION","Define TRTORCH_PATCH_VERSION","Define TRTORCH_VERSION","Define XSTR","Define TRTORCH_MINOR_VERSION","Directory cpp","Directory api","Directory include","Directory trtorch","Enum Level","File logging.h","File macros.h","File ptq.h","File trtorch.h","File Hierarchy","Function trtorch::logging::get_reportable_log_level","Function trtorch::logging::set_logging_prefix","Function trtorch::logging::get_is_colored_output_on","Function trtorch::logging::set_is_colored_output_on","Function trtorch::logging::log","Function trtorch::logging::set_reportable_log_level","Function trtorch::logging::get_logging_prefix","Template Function trtorch::ptq::make_int8_calibrator","Template Function trtorch::ptq::make_int8_cache_calibrator","Function trtorch::get_build_info","Function trtorch::CompileGraph","Function trtorch::set_device","Function trtorch::dump_build_info","Function trtorch::CheckMethodOperatorSupport","Function trtorch::ConvertGraphToTRTEngine","Namespace trtorch","Namespace trtorch::logging","Namespace trtorch::ptq","Program Listing for File logging.h","Program Listing for File macros.h","Program Listing for File ptq.h","Program Listing for File trtorch.h","Struct CompileSpec","Struct CompileSpec::Device","Struct CompileSpec::InputRange","TRTorch C++ API","Full API","Full API","TRTorch Getting Started - ResNet 50","TRTorch Getting Started - LeNet","Object Detection with TRTorch (SSD)","Conversion Phase","Lowering Phase","Compiler Phases","Runtime Phase","System Overview","Useful Links for TRTorch Development","Writing Converters","TRTorch","Operators Supported","trtorch.logging","trtorch","Getting Started","Installation","Post Training Quantization (PTQ)","Deploying TRTorch Programs","trtorchc","Using TRTorch Directly From PyTorch","DLA"],titleterms:{"class":[0,1,2,3,4,20,21,38,40,48,49],"enum":[17,18,39,48,49,64],"function":[18,20,21,23,24,25,26,27,28,29,30,31,32,33,34,35,36,37,38,39,40,48,49,59,64],The:65,Used:55,Useful:59,Using:[65,70],aarch64:66,abi:66,addmm:55,advic:60,ahead:61,api:[14,18,19,20,21,48,49,50,59,61,66],applic:67,arg:60,avail:59,background:[57,60,65],base:[3,4],benchmark:[51,53],binari:66,branch:55,build:66,checkmethodoperatorsupport:36,citat:67,cli:66,code:55,compil:[56,58,61,65,66],compilegraph:33,compilespec:[1,45,46,47],conclus:[52,53],construct:57,content:[18,19,20,21,38,39,40,51,52,53],context:60,contigu:55,contract:60,contributor:61,convers:[54,56,58,60],convert:[54,60,62,65],convertgraphtotrtengin:37,cpp:[13,18,19,20,21],creat:[65,67],cudnn:66,current:62,custom:65,cxx11:66,datatyp:1,dead:55,debug:66,defin:[5,6,7,8,9,10,11,12,19,48,49],definit:[18,19,20,21],depend:66,deploi:68,descript:[51,53],deseri:57,detail:53,detect:53,detector:53,develop:59,devic:[2,46],devicetyp:2,dimens:59,directli:70,directori:[13,14,15,16,50],disk:65,distribut:66,dla:71,documen:61,document:[1,2,3,4,5,6,7,8,9,10,11,12,17,23,24,25,26,27,28,29,30,31,32,33,34,35,36,37,45,46,47,59,61],dropout:55,dump_build_info:35,easier:59,elimin:55,eliminatecommonsubexpress:55,engin:57,envior:66,evalu:[54,62],execept:55,executor:57,expect:59,file:[16,18,19,20,21,22,41,42,43,44,48,50],flatten:55,fp16:51,fp32:51,freez:55,from:[66,70],full:[48,49,50],fuse:55,gaurd:55,get:[51,52,61,65],get_build_info:32,get_is_colored_output_on:25,get_logging_prefix:29,get_reportable_log_level:23,gpu:61,graph:[55,57],guarante:60,half:51,hierarchi:[0,22,48],hood:65,how:67,includ:[15,18,19,20,21],indic:61,infer:53,inherit:[3,4],inputrang:47,instal:66,int8cachecalibr:3,int8calibr:4,jetson:66,jit:61,layer:59,learn:[51,52,53],lenet:52,level:17,librari:[66,68],libtrtorch:68,linear:55,link:59,list:[41,42,43,44],local:66,log:[18,23,24,25,26,27,28,29,39,41,63],logsoftmax:55,loop:55,lower:[55,56,58],macro:[19,42],make_int8_cache_calibr:31,make_int8_calibr:30,measur:53,model:[51,52,53],modul:[55,65],multibox:53,namespac:[18,20,21,38,39,40,48,49],nativ:66,native_op:59,nest:[1,2,45,46,47],next:[51,52],node:54,nvidia:61,object:[51,52,53],oper:[62,65],optimz:55,other:60,overview:[51,52,53,58],own:67,packag:[66,68],pass:55,pattern:55,peephol:55,phase:[54,55,56,57,58],post:67,pre:66,precis:51,precompil:66,prerequisit:66,program:[41,42,43,44,68],ptq:[20,30,31,40,43,67],python:[59,61,65,66,67],pytorch:[52,59,61,70],quantiz:67,quickstart:65,read:59,redund:55,refer:53,regist:65,relationship:[1,2,3,4,45,46,47],releas:66,remov:55,resnet:51,respons:60,result:[53,57],runtim:[56,57,58,68],sampl:53,save:65,script:52,serial:57,set_devic:34,set_is_colored_output_on:26,set_logging_prefix:24,set_reportable_log_level:28,setup:66,shot:53,singl:[51,53],sometim:59,sourc:66,speedup:53,ssd:53,start:[51,52,61,65],str:5,struct:[45,46,47,48,49],subdirectori:[13,14,15],submodul:64,support:62,system:58,tarbal:66,templat:[3,4,30,31],tensorrt:[57,59,66],through:62,time:61,torchscript:[52,61,65],trace:[51,52],train:67,trtorch:[16,18,19,20,21,23,24,25,26,27,28,29,30,31,32,33,34,35,36,37,38,39,40,44,48,51,52,53,59,61,63,64,65,68,70],trtorch_api:6,trtorch_hidden:7,trtorch_major_vers:8,trtorch_minor_vers:12,trtorch_patch_vers:9,trtorch_vers:10,trtorchc:[65,69],tupl:55,type:[3,4,45,46],under:65,unpack:55,unrol:55,unsupport:65,using:66,util:[51,53],visual:53,weight:60,what:[51,52,60],work:65,write:60,xstr:11,your:67}}) \ No newline at end of file diff --git a/docs/tutorials/ptq.html b/docs/tutorials/ptq.html index 04046057f4..90b72e4d4b 100644 --- a/docs/tutorials/ptq.html +++ b/docs/tutorials/ptq.html @@ -253,8 +253,13 @@