Skip to content

Commit

Permalink
Deployed 6b48c60 with MkDocs version: 1.1.2
Browse files Browse the repository at this point in the history
  • Loading branch information
Unknown committed Dec 16, 2024
1 parent 885f374 commit 93d74f7
Show file tree
Hide file tree
Showing 6 changed files with 133 additions and 220 deletions.
2 changes: 1 addition & 1 deletion search/search_index.json
View file

Large diffs are not rendered by default.

72 changes: 36 additions & 36 deletions sitemap.xml
View file
Original file line number Diff line number Diff line change
@@ -1,147 +1,147 @@
<?xml version="1.0" encoding="UTF-8"?>
<urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9"><url>
<loc>https://htcondor.github.io/htcondor-ce/</loc>
<lastmod>2024-11-20</lastmod>
<lastmod>2024-12-16</lastmod>
<changefreq>daily</changefreq>
</url><url>
<loc>https://htcondor.github.io/htcondor-ce/architecture/</loc>
<lastmod>2024-11-20</lastmod>
<lastmod>2024-12-16</lastmod>
<changefreq>daily</changefreq>
</url><url>
<loc>https://htcondor.github.io/htcondor-ce/v24/installation/htcondor-ce/</loc>
<lastmod>2024-11-20</lastmod>
<lastmod>2024-12-16</lastmod>
<changefreq>daily</changefreq>
</url><url>
<loc>https://htcondor.github.io/htcondor-ce/v24/configuration/authentication/</loc>
<lastmod>2024-11-20</lastmod>
<lastmod>2024-12-16</lastmod>
<changefreq>daily</changefreq>
</url><url>
<loc>https://htcondor.github.io/htcondor-ce/v24/configuration/local-batch-system/</loc>
<lastmod>2024-11-20</lastmod>
<lastmod>2024-12-16</lastmod>
<changefreq>daily</changefreq>
</url><url>
<loc>https://htcondor.github.io/htcondor-ce/v24/configuration/job-router-overview/</loc>
<lastmod>2024-11-20</lastmod>
<lastmod>2024-12-16</lastmod>
<changefreq>daily</changefreq>
</url><url>
<loc>https://htcondor.github.io/htcondor-ce/v24/configuration/writing-job-routes/</loc>
<lastmod>2024-11-20</lastmod>
<lastmod>2024-12-16</lastmod>
<changefreq>daily</changefreq>
</url><url>
<loc>https://htcondor.github.io/htcondor-ce/v24/configuration/htcondor-routes/</loc>
<lastmod>2024-11-20</lastmod>
<lastmod>2024-12-16</lastmod>
<changefreq>daily</changefreq>
</url><url>
<loc>https://htcondor.github.io/htcondor-ce/v24/configuration/non-htcondor-routes/</loc>
<lastmod>2024-11-20</lastmod>
<lastmod>2024-12-16</lastmod>
<changefreq>daily</changefreq>
</url><url>
<loc>https://htcondor.github.io/htcondor-ce/v24/configuration/optional-configuration/</loc>
<lastmod>2024-11-20</lastmod>
<lastmod>2024-12-16</lastmod>
<changefreq>daily</changefreq>
</url><url>
<loc>https://htcondor.github.io/htcondor-ce/v24/operation/</loc>
<lastmod>2024-11-20</lastmod>
<lastmod>2024-12-16</lastmod>
<changefreq>daily</changefreq>
</url><url>
<loc>https://htcondor.github.io/htcondor-ce/v24/troubleshooting/common-issues/</loc>
<lastmod>2024-11-20</lastmod>
<lastmod>2024-12-16</lastmod>
<changefreq>daily</changefreq>
</url><url>
<loc>https://htcondor.github.io/htcondor-ce/v24/troubleshooting/debugging-tools/</loc>
<lastmod>2024-11-20</lastmod>
<lastmod>2024-12-16</lastmod>
<changefreq>daily</changefreq>
</url><url>
<loc>https://htcondor.github.io/htcondor-ce/v24/troubleshooting/logs/</loc>
<lastmod>2024-11-20</lastmod>
<lastmod>2024-12-16</lastmod>
<changefreq>daily</changefreq>
</url><url>
<loc>https://htcondor.github.io/htcondor-ce/v24/remote-job-submission/</loc>
<lastmod>2024-11-20</lastmod>
<lastmod>2024-12-16</lastmod>
<changefreq>daily</changefreq>
</url><url>
<loc>https://htcondor.github.io/htcondor-ce/v24/troubleshooting/remote-troubleshooting/</loc>
<lastmod>2024-11-20</lastmod>
<lastmod>2024-12-16</lastmod>
<changefreq>daily</changefreq>
</url><url>
<loc>https://htcondor.github.io/htcondor-ce/v24/installation/central-collector/</loc>
<lastmod>2024-11-20</lastmod>
<lastmod>2024-12-16</lastmod>
<changefreq>daily</changefreq>
</url><url>
<loc>https://htcondor.github.io/htcondor-ce/v24/releases/</loc>
<lastmod>2024-11-20</lastmod>
<lastmod>2024-12-16</lastmod>
<changefreq>daily</changefreq>
</url><url>
<loc>https://htcondor.github.io/htcondor-ce/v24/reference/</loc>
<lastmod>2024-11-20</lastmod>
<lastmod>2024-12-16</lastmod>
<changefreq>daily</changefreq>
</url><url>
<loc>https://htcondor.github.io/htcondor-ce/v23/installation/htcondor-ce/</loc>
<lastmod>2024-11-20</lastmod>
<lastmod>2024-12-16</lastmod>
<changefreq>daily</changefreq>
</url><url>
<loc>https://htcondor.github.io/htcondor-ce/v23/configuration/authentication/</loc>
<lastmod>2024-11-20</lastmod>
<lastmod>2024-12-16</lastmod>
<changefreq>daily</changefreq>
</url><url>
<loc>https://htcondor.github.io/htcondor-ce/v23/configuration/local-batch-system/</loc>
<lastmod>2024-11-20</lastmod>
<lastmod>2024-12-16</lastmod>
<changefreq>daily</changefreq>
</url><url>
<loc>https://htcondor.github.io/htcondor-ce/v23/configuration/job-router-overview/</loc>
<lastmod>2024-11-20</lastmod>
<lastmod>2024-12-16</lastmod>
<changefreq>daily</changefreq>
</url><url>
<loc>https://htcondor.github.io/htcondor-ce/v23/configuration/writing-job-routes/</loc>
<lastmod>2024-11-20</lastmod>
<lastmod>2024-12-16</lastmod>
<changefreq>daily</changefreq>
</url><url>
<loc>https://htcondor.github.io/htcondor-ce/v23/configuration/htcondor-routes/</loc>
<lastmod>2024-11-20</lastmod>
<lastmod>2024-12-16</lastmod>
<changefreq>daily</changefreq>
</url><url>
<loc>https://htcondor.github.io/htcondor-ce/v23/configuration/non-htcondor-routes/</loc>
<lastmod>2024-11-20</lastmod>
<lastmod>2024-12-16</lastmod>
<changefreq>daily</changefreq>
</url><url>
<loc>https://htcondor.github.io/htcondor-ce/v23/configuration/optional-configuration/</loc>
<lastmod>2024-11-20</lastmod>
<lastmod>2024-12-16</lastmod>
<changefreq>daily</changefreq>
</url><url>
<loc>https://htcondor.github.io/htcondor-ce/v23/operation/</loc>
<lastmod>2024-11-20</lastmod>
<lastmod>2024-12-16</lastmod>
<changefreq>daily</changefreq>
</url><url>
<loc>https://htcondor.github.io/htcondor-ce/v23/troubleshooting/common-issues/</loc>
<lastmod>2024-11-20</lastmod>
<lastmod>2024-12-16</lastmod>
<changefreq>daily</changefreq>
</url><url>
<loc>https://htcondor.github.io/htcondor-ce/v23/troubleshooting/debugging-tools/</loc>
<lastmod>2024-11-20</lastmod>
<lastmod>2024-12-16</lastmod>
<changefreq>daily</changefreq>
</url><url>
<loc>https://htcondor.github.io/htcondor-ce/v23/troubleshooting/logs/</loc>
<lastmod>2024-11-20</lastmod>
<lastmod>2024-12-16</lastmod>
<changefreq>daily</changefreq>
</url><url>
<loc>https://htcondor.github.io/htcondor-ce/v23/remote-job-submission/</loc>
<lastmod>2024-11-20</lastmod>
<lastmod>2024-12-16</lastmod>
<changefreq>daily</changefreq>
</url><url>
<loc>https://htcondor.github.io/htcondor-ce/v23/troubleshooting/remote-troubleshooting/</loc>
<lastmod>2024-11-20</lastmod>
<lastmod>2024-12-16</lastmod>
<changefreq>daily</changefreq>
</url><url>
<loc>https://htcondor.github.io/htcondor-ce/v23/installation/central-collector/</loc>
<lastmod>2024-11-20</lastmod>
<lastmod>2024-12-16</lastmod>
<changefreq>daily</changefreq>
</url><url>
<loc>https://htcondor.github.io/htcondor-ce/v23/releases/</loc>
<lastmod>2024-11-20</lastmod>
<lastmod>2024-12-16</lastmod>
<changefreq>daily</changefreq>
</url><url>
<loc>https://htcondor.github.io/htcondor-ce/v23/reference/</loc>
<lastmod>2024-11-20</lastmod>
<lastmod>2024-12-16</lastmod>
<changefreq>daily</changefreq>
</url>
</urlset>
Binary file modified sitemap.xml.gz
View file
Binary file not shown.
32 changes: 10 additions & 22 deletions v24/configuration/htcondor-routes/index.html
View file
Original file line number Diff line number Diff line change
Expand Up @@ -1108,21 +1108,18 @@ <h2 id="setting-periodic-hold-or-release">Setting periodic hold or release<a cla
<p>In this example, we set the routed job on hold if the job is idle and has been started at least once or if the job has
tried to start more than once.
This will catch jobs which are starting and stopping multiple times.</p>
<div class="codehilite"><pre><span></span><code>```hl_lines=&quot;5 8&quot;
JOB_ROUTER_ROUTE_Condor_Pool @=jrt
<div class="highlight"><pre><span></span><code>JOB_ROUTER_ROUTE_Condor_Pool @=jrt
UNIVERSE VANILLA
# Puts the routed job on hold if the job&#39;s been idle and has been started at least
# once or if the job has tried to start more than once
SET PeriodicHold ((NumJobStarts &gt;= 1 &amp;&amp; JobStatus == 1) || NumJobStarts &gt; 1)
# Release routed jobs if the condor_starter couldn&#39;t start the executable and
<span class="hll"> SET PeriodicHold ((NumJobStarts &gt;= 1 &amp;&amp; JobStatus == 1) || NumJobStarts &gt; 1)
</span> # Release routed jobs if the condor_starter couldn&#39;t start the executable and
# &#39;VMGAHP_ERR_INTERNAL&#39; is in the HoldReason
SET PeriodicRelease = (HoldReasonCode == 6 &amp;&amp; regexp(&quot;VMGAHP_ERR_INTERNAL&quot;, HoldReason))
@jrt
<span class="hll"> SET PeriodicRelease = (HoldReasonCode == 6 &amp;&amp; regexp(&quot;VMGAHP_ERR_INTERNAL&quot;, HoldReason))
</span>@jrt

JOB_ROUTER_ROUTE_NAMES = Condor_Pool
```
</code></pre></div>

<h2 id="setting-routed-job-requirements">Setting routed job requirements<a class="headerlink" href="#setting-routed-job-requirements" title="Permanent link">&para;</a></h2>
<p>If you need to set requirements on your routed job, you will need to use <code>SET REQUIREMENTS</code>
instead of <code>Requirements</code>.
Expand All @@ -1131,26 +1128,20 @@ <h2 id="setting-routed-job-requirements">Setting routed job requirements<a class
For more information on requirements, consult the
<a href="https://htcondor.readthedocs.io/en/lts/users-manual/submitting-a-job.html#about-requirements-and-rank">HTCondor manual</a>.</p>
<p>To ensure that your job lands on a Linux machine in your pool:</p>
<div class="codehilite"><pre><span></span><code>```hl_lines=&quot;3&quot;
JOB_ROUTER_ROUTE_Condor_Pool @jrt
<div class="highlight"><pre><span></span><code>JOB_ROUTER_ROUTE_Condor_Pool @jrt
UNIVERSE VANILLA
SET Requirements = (TARGET.OpSys == &quot;LINUX&quot;)
@jrt
<span class="hll"> SET Requirements = (TARGET.OpSys == &quot;LINUX&quot;)
</span>@jrt

JOB_ROUTER_ROUTE_NAMES = Condor_Pool
```
</code></pre></div>

<h3 id="preserving-original-job-requirements">Preserving original job requirements<a class="headerlink" href="#preserving-original-job-requirements" title="Permanent link">&para;</a></h3>
<p>To preserve and include the original job requirements, rather than just setting new requirements, you can use <code>COPY
Requirements</code> or <code>copy_Requirements</code> to store the current value of <code>Requirements</code> to another variable, which we'll call
<code>original_requirements</code>.
To do this, replace the above <code>SET Requirements</code> or <code>set_Requirements</code> lines with:</p>
<div class="codehilite"><pre><span></span><code>```
SET Requirements = ($(MY.Requirements)) &amp;&amp; (&lt;YOUR REQUIREMENTS EXPRESSION&gt;)
```
<div class="highlight"><pre><span></span><code>SET Requirements = ($(MY.Requirements)) &amp;&amp; (&lt;YOUR REQUIREMENTS EXPRESSION&gt;)
</code></pre></div>

<h3 id="setting-the-accounting-group-based-on-the-credential-of-the-submitted-job">Setting the accounting group based on the credential of the submitted job<a class="headerlink" href="#setting-the-accounting-group-based-on-the-credential-of-the-submitted-job" title="Permanent link">&para;</a></h3>
<p>A common need in the CE is to want to set the accounting identity of the routed job using information from the credential
of the submitter of the job. This originally was done using information from the x509 certificate, in particular <code>X509UserProxyVOName</code>
Expand All @@ -1161,8 +1152,7 @@ <h3 id="setting-the-accounting-group-based-on-the-credential-of-the-submitted-jo
original job. This is different from the way the <code>x509*</code> job attributes behaved.</p>
<p>Because of this, the default CE config will copy all attributes that match <code>AuthToken*</code> to <code>orig_AuthToken*</code> before the route transforms are applied.</p>
<p>Example of setting the accounting group from AuthToken or x509 attributes.</p>
<div class="codehilite"><pre><span></span><code>```
JOB_ROUTER_CLASSAD_USER_MAP_NAMES = $(JOB_ROUTER_CLASSAD_USER_MAP_NAMES) AcctGroupMap
<div class="highlight"><pre><span></span><code>JOB_ROUTER_CLASSAD_USER_MAP_NAMES = $(JOB_ROUTER_CLASSAD_USER_MAP_NAMES) AcctGroupMap
CLASSAD_USER_MAPFILE_AcctGroupMap = &lt;path-to-mapfile&gt;

JOB_ROUTER_TRANSFORM_SetAcctGroup @=end
Expand All @@ -1172,9 +1162,7 @@ <h3 id="setting-the-accounting-group-based-on-the-credential-of-the-submitted-jo
@end

JOB_ROUTER_PRE_ROUTE_TRANSFORMS = $(JOB_ROUTER_PRE_ROUTE_TRANSFORMS) SetAcctGroup
```
</code></pre></div>

<p>Refer to the HTCondor documentation for <a href="https://htcondor.readthedocs.io/en/lts/admin-manual/security.html?highlight=mapfile#the-unified-map-file-for-authentication">information on mapfiles</a>.</p>
<h2 id="getting-help">Getting Help<a class="headerlink" href="#getting-help" title="Permanent link">&para;</a></h2>
<p>If you have any questions or issues with configuring job routes, please <a href="../../..#contact-us">contact us</a> for
Expand Down
27 changes: 9 additions & 18 deletions v24/configuration/non-htcondor-routes/index.html
View file
Original file line number Diff line number Diff line change
Expand Up @@ -1073,16 +1073,13 @@ <h1 id="for-non-htcondor-batch-systems">For Non-HTCondor Batch Systems<a class="
<p>This page contains information about job routes that can be used if you are running a non-HTCondor pool at your site.</p>
<h2 id="setting-a-default-batch-queue">Setting a default batch queue<a class="headerlink" href="#setting-a-default-batch-queue" title="Permanent link">&para;</a></h2>
<p>To set a default queue for routed jobs, set the variable <code>default_queue</code>:</p>
<div class="codehilite"><pre><span></span><code>```hl_lines=&quot;3&quot;
JOB_ROUTER_ROUTE_Slurm_Cluster @=jrt
<div class="highlight"><pre><span></span><code>JOB_ROUTER_ROUTE_Slurm_Cluster @=jrt
GridResource = &quot;batch slurm&quot;
default_queue = osg_queue
@jrt
<span class="hll"> default_queue = osg_queue
</span>@jrt

JOB_ROUTER_ROUTE_NAMES = Slurm_Cluster
```
</code></pre></div>

<h2 id="setting-batch-system-directives">Setting batch system directives<a class="headerlink" href="#setting-batch-system-directives" title="Permanent link">&para;</a></h2>
<p>To write batch system directives that are not supported in the route examples above, you will need to edit the job
submit script for your local batch system in <code>/etc/blahp/</code>
Expand All @@ -1091,28 +1088,22 @@ <h2 id="setting-batch-system-directives">Setting batch system directives<a class
submit script.
ClassAd attributes can be passed from the routed job to the local submit attributes script via
<code>default_CERequirements</code> attribute, which takes a comma-separated list of other attributes:</p>
<div class="codehilite"><pre><span></span><code>```
SET foo = &quot;X&quot;
<div class="highlight"><pre><span></span><code>SET foo = &quot;X&quot;
SET bar = &quot;Y&quot;
SET default_CERequirements = &quot;foo,bar&quot;
```
</code></pre></div>

<p>This sets <code>foo</code> to the string <code>X</code> and <code>bar</code> to the string <code>Y</code> in the environment of the local submit attributes script.</p>
<p>The following example sets the maximum walltime to 1 hour and the accounting group to the <code>x509UserProxyFirstFQAN</code>
attribute of the job submitted to a PBS batch system:</p>
<div class="codehilite"><pre><span></span><code>```hl_lines=&quot;4 5 6&quot;
JOB_ROUTER_ROUTE_Slurm_Cluster @=jrt
<div class="highlight"><pre><span></span><code>JOB_ROUTER_ROUTE_Slurm_Cluster @=jrt
GridResource = &quot;batch slurm&quot;
SET Walltime = 3600
SET AccountingGroup = x509UserProxyFirstFQAN
SET default_CERequirements = &quot;WallTime,AccountingGroup&quot;
@jrt

<span class="hll"> SET AccountingGroup = x509UserProxyFirstFQAN
</span><span class="hll"> SET default_CERequirements = &quot;WallTime,AccountingGroup&quot;
</span><span class="hll">@jrt
</span>
JOB_ROUTER_ROUTE_NAMES = Slurm_Cluster
```
</code></pre></div>

<p>With <code>/etc/blahp/pbs_local_submit_attributes.sh</code> containing:</p>
<div class="highlight"><pre><span></span><code>#!/bin/bash
echo &quot;#PBS -l walltime=$Walltime&quot;
Expand Down
Loading

0 comments on commit 93d74f7

Please sign in to comment.