Skip to content

Commit

Permalink
tool: Opset coverage notebook
Browse files Browse the repository at this point in the history
Signed-off-by: Naren Dasan <[email protected]>
Signed-off-by: Naren Dasan <[email protected]>
  • Loading branch information
narendasan committed May 13, 2024
1 parent 4dc9acf commit b0937fb
Show file tree
Hide file tree
Showing 167 changed files with 7,212 additions and 5,416 deletions.
5 changes: 5 additions & 0 deletions .gitignore
Original file line number Diff line number Diff line change
Expand Up @@ -69,3 +69,8 @@ bazel-tensorrt
bazel-project
build/
wheelhouse/
*_status.json
tests/py/dynamo/models/*.ts
tests/py/dynamo/models/*.ep
*.deb
*.tar.xz
52 changes: 30 additions & 22 deletions docs/_cpp_api/classtorch__tensorrt_1_1DataType.html

Large diffs are not rendered by default.

36 changes: 21 additions & 15 deletions docs/_cpp_api/classtorch__tensorrt_1_1Device_1_1DeviceType.html
Original file line number Diff line number Diff line change
Expand Up @@ -10,7 +10,7 @@

<meta name="viewport" content="width=device-width, initial-scale=1.0">

<title>Class Device::DeviceType &mdash; Torch-TensorRT v2.3.0.dev0+85971ff documentation</title>
<title>Class Device::DeviceType &mdash; Torch-TensorRT v2.4.0.dev0+4dc9acfc9 documentation</title>



Expand Down Expand Up @@ -237,7 +237,7 @@


<div class="version">
v2.3.0.dev0+85971ff
v2.4.0.dev0+4dc9acfc9
</div>


Expand Down Expand Up @@ -304,6 +304,9 @@
<li class="toctree-l1"><a class="reference internal" href="../tutorials/_rendered_examples/dynamo/torch_compile_transformers_example.html">Compiling a Transformer using torch.compile and TensorRT</a></li>
<li class="toctree-l1"><a class="reference internal" href="../tutorials/_rendered_examples/dynamo/torch_compile_advanced_usage.html">Torch Compile Advanced Usage</a></li>
<li class="toctree-l1"><a class="reference internal" href="../tutorials/_rendered_examples/dynamo/torch_compile_stable_diffusion.html">Torch Compile Stable Diffusion</a></li>
<li class="toctree-l1"><a class="reference internal" href="../tutorials/_rendered_examples/dynamo/custom_kernel_plugins.html">Using Custom Kernels within TensorRT Engines with Torch-TensorRT</a></li>
<li class="toctree-l1"><a class="reference internal" href="../tutorials/_rendered_examples/dynamo/custom_kernel_plugins.html#wrapping-custom-kernels-to-use-in-tensorrt">Wrapping Custom Kernels to use in TensorRT</a></li>
<li class="toctree-l1"><a class="reference internal" href="../tutorials/_rendered_examples/dynamo/custom_kernel_plugins.html#using-torch-tensorrt-to-insert-the-kernel">Using Torch-TensorRT to Insert the Kernel</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">Python API Documenation</span></p>
<ul>
Expand Down Expand Up @@ -416,19 +419,19 @@
<article itemprop="articleBody" id="pytorch-article" class="pytorch-article">

<section id="class-device-devicetype">
<span id="exhale-class-classtorch-tensorrt-1-1device-1-1devicetype"></span><h1>Class Device::DeviceType<a class="headerlink" href="#class-device-devicetype" title="Permalink to this headline"></a></h1>
<span id="exhale-class-classtorch-tensorrt-1-1device-1-1devicetype"></span><h1>Class Device::DeviceType<a class="headerlink" href="#class-device-devicetype" title="Permalink to this heading"></a></h1>
<ul class="simple">
<li><p>Defined in <a class="reference internal" href="file_cpp_include_torch_tensorrt_torch_tensorrt.h.html#file-cpp-include-torch-tensorrt-torch-tensorrt-h"><span class="std std-ref">File torch_tensorrt.h</span></a></p></li>
</ul>
<section id="nested-relationships">
<h2>Nested Relationships<a class="headerlink" href="#nested-relationships" title="Permalink to this headline"></a></h2>
<h2>Nested Relationships<a class="headerlink" href="#nested-relationships" title="Permalink to this heading"></a></h2>
<p>This class is a nested type of <a class="reference internal" href="structtorch__tensorrt_1_1Device.html#exhale-struct-structtorch-tensorrt-1-1device"><span class="std std-ref">Struct Device</span></a>.</p>
</section>
<section id="class-documentation">
<h2>Class Documentation<a class="headerlink" href="#class-documentation" title="Permalink to this headline"></a></h2>
<h2>Class Documentation<a class="headerlink" href="#class-documentation" title="Permalink to this heading"></a></h2>
<dl class="cpp class">
<dt class="sig sig-object cpp" id="_CPPv4N14torch_tensorrt6Device10DeviceTypeE">
<span class="target" id="classtorch__tensorrt_1_1Device_1_1DeviceType"></span><span class="k"><span class="pre">class</span></span><span class="w"> </span><span class="sig-prename descclassname"><span class="n"><span class="pre">torch_tensorrt</span></span><span class="p"><span class="pre">::</span></span><a class="reference internal" href="structtorch__tensorrt_1_1Device.html#_CPPv4N14torch_tensorrt6DeviceE" title="torch_tensorrt::Device"><span class="n"><span class="pre">Device</span></span></a><span class="p"><span class="pre">::</span></span></span><span class="sig-name descname"><span class="n"><span class="pre">DeviceType</span></span></span><a class="headerlink" href="#_CPPv4N14torch_tensorrt6Device10DeviceTypeE" title="Permalink to this definition"></a><br /></dt>
<span class="target" id="classtorch__tensorrt_1_1Device_1_1DeviceType"></span><span class="k"><span class="pre">class</span></span><span class="w"> </span><span class="sig-name descname"><span class="n"><span class="pre">DeviceType</span></span></span><a class="headerlink" href="#_CPPv4N14torch_tensorrt6Device10DeviceTypeE" title="Permalink to this definition"></a><br /></dt>
<dd><p>Supported <a class="reference internal" href="structtorch__tensorrt_1_1Device.html#structtorch__tensorrt_1_1Device"><span class="std std-ref">Device</span></a> Types that can be used with TensorRT engines</p>
<p>This class is compatable with c10::DeviceTypes (but will check for TRT support) but the only applicable value is at::kCUDA, which maps to <a class="reference internal" href="structtorch__tensorrt_1_1Device.html#classtorch__tensorrt_1_1Device_1_1DeviceType_1a23c188ccbece0f27609e8b1c7bf7e350a7096aeeb6744e578d5afd98e334f866c"><span class="std std-ref">DeviceType::kGPU</span></a></p>
<p>To use the <a class="reference internal" href="classtorch__tensorrt_1_1DataType.html#classtorch__tensorrt_1_1DataType"><span class="std std-ref">DataType</span></a> class itself, interface using the enum vs. normal instatination</p>
Expand Down Expand Up @@ -484,7 +487,7 @@ <h2>Class Documentation<a class="headerlink" href="#class-documentation" title="

<dl class="cpp function">
<dt class="sig sig-object cpp" id="_CPPv4NK14torch_tensorrt6Device10DeviceTypecv5ValueEv">
<span class="target" id="classtorch__tensorrt_1_1Device_1_1DeviceType_1a46962474415caca02f9de9a7cde182ce"></span><span class="k"><span class="pre">inline</span></span><span class="w"> </span><span class="sig-name descname"><span class="k"><span class="pre">operator</span></span><span class="w"> </span><a class="reference internal" href="#_CPPv4N14torch_tensorrt6Device10DeviceType5ValueE" title="torch_tensorrt::Device::DeviceType::Value"><span class="n"><span class="pre">Value</span></span></a></span><span class="sig-paren">(</span><span class="sig-paren">)</span><span class="w"> </span><span class="k"><span class="pre">const</span></span><a class="headerlink" href="#_CPPv4NK14torch_tensorrt6Device10DeviceTypecv5ValueEv" title="Permalink to this definition"></a><br /></dt>
<span class="target" id="classtorch__tensorrt_1_1Device_1_1DeviceType_1a4afa0b396b7a076e37054754a367f2f4"></span><span class="k"><span class="pre">inline</span></span><span class="w"> </span><span class="sig-name descname"><span class="k"><span class="pre">operator</span></span><span class="w"> </span><a class="reference internal" href="#_CPPv4N14torch_tensorrt6Device10DeviceType5ValueE" title="torch_tensorrt::Device::DeviceType::Value"><span class="n"><span class="pre">Value</span></span></a></span><span class="sig-paren">(</span><span class="sig-paren">)</span><span class="w"> </span><span class="k"><span class="pre">const</span></span><a class="headerlink" href="#_CPPv4NK14torch_tensorrt6Device10DeviceTypecv5ValueEv" title="Permalink to this definition"></a><br /></dt>
<dd><p>Get the internal value from the <a class="reference internal" href="structtorch__tensorrt_1_1Device.html#structtorch__tensorrt_1_1Device"><span class="std std-ref">Device</span></a> object. </p>
<dl class="field-list simple">
<dt class="field-odd">Returns</dt>
Expand All @@ -500,32 +503,34 @@ <h2>Class Documentation<a class="headerlink" href="#class-documentation" title="

<dl class="cpp function">
<dt class="sig sig-object cpp" id="_CPPv4NK14torch_tensorrt6Device10DeviceTypeeqE10DeviceType">
<span class="target" id="classtorch__tensorrt_1_1Device_1_1DeviceType_1ac96651e5f12e09b45a31f6f6251634ad"></span><span class="k"><span class="pre">inline</span></span><span class="w"> </span><span class="k"><span class="pre">constexpr</span></span><span class="w"> </span><span class="kt"><span class="pre">bool</span></span><span class="w"> </span><span class="sig-name descname"><span class="k"><span class="pre">operator</span></span><span class="o"><span class="pre">==</span></span></span><span class="sig-paren">(</span><a class="reference internal" href="#_CPPv4N14torch_tensorrt6Device10DeviceTypeE" title="torch_tensorrt::Device::DeviceType"><span class="n"><span class="pre">DeviceType</span></span></a><span class="w"> </span><span class="n sig-param"><span class="pre">other</span></span><span class="sig-paren">)</span><span class="w"> </span><span class="k"><span class="pre">const</span></span><a class="headerlink" href="#_CPPv4NK14torch_tensorrt6Device10DeviceTypeeqE10DeviceType" title="Permalink to this definition"></a><br /></dt>
<span class="target" id="classtorch__tensorrt_1_1Device_1_1DeviceType_1a0177ee9788edabb89a8cb64234d2a60c"></span><span class="k"><span class="pre">inline</span></span><span class="w"> </span><span class="k"><span class="pre">constexpr</span></span><span class="w"> </span><span class="kt"><span class="pre">bool</span></span><span class="w"> </span><span class="sig-name descname"><span class="k"><span class="pre">operator</span></span><span class="o"><span class="pre">==</span></span></span><span class="sig-paren">(</span><a class="reference internal" href="#_CPPv4N14torch_tensorrt6Device10DeviceTypeE" title="torch_tensorrt::Device::DeviceType"><span class="n"><span class="pre">DeviceType</span></span></a><span class="w"> </span><span class="n sig-param"><span class="pre">other</span></span><span class="sig-paren">)</span><span class="w"> </span><span class="k"><span class="pre">const</span></span><a class="headerlink" href="#_CPPv4NK14torch_tensorrt6Device10DeviceTypeeqE10DeviceType" title="Permalink to this definition"></a><br /></dt>
<dd><p>Comparison operator for <a class="reference internal" href="structtorch__tensorrt_1_1Device.html#classtorch__tensorrt_1_1Device_1_1DeviceType"><span class="std std-ref">DeviceType</span></a>. </p>
<dl class="field-list simple">
<dt class="field-odd">Parameters</dt>
<dd class="field-odd"><p><strong>other</strong></p>
</dd>
<dt class="field-even">Returns</dt>
<dd class="field-even"><p><p>true </p>
<p>false </p>
</p>
<dd class="field-even"><p>true </p>
</dd>
<dt class="field-odd">Returns</dt>
<dd class="field-odd"><p>false </p>
</dd>
</dl>
</dd></dl>

<dl class="cpp function">
<dt class="sig sig-object cpp" id="_CPPv4NK14torch_tensorrt6Device10DeviceTypeneE10DeviceType">
<span class="target" id="classtorch__tensorrt_1_1Device_1_1DeviceType_1af537ba74a76ce0b17aec3e4af9c0b5ad"></span><span class="k"><span class="pre">inline</span></span><span class="w"> </span><span class="k"><span class="pre">constexpr</span></span><span class="w"> </span><span class="kt"><span class="pre">bool</span></span><span class="w"> </span><span class="sig-name descname"><span class="k"><span class="pre">operator</span></span><span class="o"><span class="pre">!=</span></span></span><span class="sig-paren">(</span><a class="reference internal" href="#_CPPv4N14torch_tensorrt6Device10DeviceTypeE" title="torch_tensorrt::Device::DeviceType"><span class="n"><span class="pre">DeviceType</span></span></a><span class="w"> </span><span class="n sig-param"><span class="pre">other</span></span><span class="sig-paren">)</span><span class="w"> </span><span class="k"><span class="pre">const</span></span><a class="headerlink" href="#_CPPv4NK14torch_tensorrt6Device10DeviceTypeneE10DeviceType" title="Permalink to this definition"></a><br /></dt>
<span class="target" id="classtorch__tensorrt_1_1Device_1_1DeviceType_1a0d8973b436226f17597d94f4e8f63336"></span><span class="k"><span class="pre">inline</span></span><span class="w"> </span><span class="k"><span class="pre">constexpr</span></span><span class="w"> </span><span class="kt"><span class="pre">bool</span></span><span class="w"> </span><span class="sig-name descname"><span class="k"><span class="pre">operator</span></span><span class="o"><span class="pre">!=</span></span></span><span class="sig-paren">(</span><a class="reference internal" href="#_CPPv4N14torch_tensorrt6Device10DeviceTypeE" title="torch_tensorrt::Device::DeviceType"><span class="n"><span class="pre">DeviceType</span></span></a><span class="w"> </span><span class="n sig-param"><span class="pre">other</span></span><span class="sig-paren">)</span><span class="w"> </span><span class="k"><span class="pre">const</span></span><a class="headerlink" href="#_CPPv4NK14torch_tensorrt6Device10DeviceTypeneE10DeviceType" title="Permalink to this definition"></a><br /></dt>
<dd><p>Comparison operator for <a class="reference internal" href="structtorch__tensorrt_1_1Device.html#classtorch__tensorrt_1_1Device_1_1DeviceType"><span class="std std-ref">DeviceType</span></a>. </p>
<dl class="field-list simple">
<dt class="field-odd">Parameters</dt>
<dd class="field-odd"><p><strong>other</strong></p>
</dd>
<dt class="field-even">Returns</dt>
<dd class="field-even"><p><p>true </p>
<p>false </p>
</p>
<dd class="field-even"><p>true </p>
</dd>
<dt class="field-odd">Returns</dt>
<dd class="field-odd"><p>false </p>
</dd>
</dl>
</dd></dl>
Expand Down Expand Up @@ -602,6 +607,7 @@ <h2>Class Documentation<a class="headerlink" href="#class-documentation" title="
<script data-url_root="../" id="documentation_options" src="../_static/documentation_options.js"></script>
<script src="../_static/jquery.js"></script>
<script src="../_static/underscore.js"></script>
<script src="../_static/_sphinx_javascript_frameworks_compat.js"></script>
<script src="../_static/doctools.js"></script>
<script src="../_static/collapsible-lists/js/CollapsibleLists.compressed.js"></script>
<script src="../_static/collapsible-lists/js/apply-collapsible-lists.js"></script>
Expand Down
Loading

0 comments on commit b0937fb

Please sign in to comment.