Version 23 Feature Releases
We release new features in these releases of HTCondor. The details of each version are described below.
HTCondor version 23.4.0 released on February 8, 2023.
This version includes all the updates from Version 23.0.4.
On RPM-based distributions, a new package
condor-credmon-localis now available which provides the local SciTokens issuer credmon without installing extra packages required by the OAuth credmon. The
condor-credmon-localpackage is now a dependency of the
Jobs that are assigned nVidia GPUs now have the environment variable NVIDIA_VISIBLE_DEVICES set in addition to, and with the same value as CUDA_VISIBLE_DEVICES, as newer nVidia run-times prefer the former. (HTCONDOR-2189)
Added job ClassAd attribute
ContainerImageSource, a string which is is set to the source of the image transfer. (HTCONDOR-1797)
condor_submit now generates requirements expressions for condor grid universe jobs like it does for vanilla universe jobs. This can be disabled by setting the new configuration parameter SUBMIT_GENERATE_CONDOR_C_REQUIREMENTS to
HTCondor version 23.3.1 released on January 23, 2023.
HTCondor tarballs now contain Pelican 7.4.0
HTCondor version 23.3.0 released on January 4, 2023.
Limited support for Enterprise Linux 7 in the 23.x feature versions. Since we are developing new features, the Enterprise Linux 7 build may drop features or be dropped entirely. In particular, Python 2 and OATH credmon support will be removed during the 23.x development cycle. (HTCONDOR-2194)
This version includes all the updates from Version 23.0.3.
-convertoldroutesoption of condor_transform_ads and added a new
-help convertoption. These changes are meant to assist in the conversion of CE’s away from the deprecated transform syntax. (HTCONDOR-2146)
Improve hold message when jobs on cgroup system exceed their memory limits. (HTCONDOR-1533)
Startd now advertises when jobs are running with cgroup enforcement in the slot attribute
START_CRON_LOG_NON_ZERO_EXIT now also logs the stderr of the startd cron job to the StartLog. (HTCONDOR-1138)
HTCondor version 23.2.0 released on November 29, 2023.
This version includes all the updates from Version 23.0.2.
Added periodic_vacate to the submit language and SYSTEM_PERIODIC_VACATE to the configuration system. Historically, users used periodic_hold/release to evict “stuck” jobs, that is jobs that should finish in some amount of time, but sometimes run for an arbitrarily long time. Now with this new feature, for improved usability, users may use this single
periodic_vacatesubmit command instead. (HTCONDOR-2114)
Linux EPs now advertise the startd attribute HasRotationalScratch to be
truewhen HTCondor detects that the execute directory is on a rotational hard disk and false when the kernel reports it to be on SSD, NVME, or tmpfs. (HTCONDOR-2085)
TimeExecuteto the event log terminate events to indicate how much wall time a job used total (including file transfer) and just for the job execution proper, respectively. (HTCONDOR-2101)
Most files that HTCondor generates are now written in binary mode on Windows. As a result, each line in these files will end in just a line feed character, without a preceding carriage return character. Files written by jobs are unaffected by this change. (HTCONDOR-2098)
HTCondor now does a better job of cleaning up inner cgroups left behind by glidein pilots. (HTCONDOR-2081)
The default trusted CAs for OpenSSL are now always used by default in addition to any specified by AUTH_SSL_SERVER_CAFILE, AUTH_SSL_CLIENT_CAFILE, AUTH_SSL_SERVER_CADIR, and AUTH_SSL_CLIENT_CADIR. The new configuration parameters AUTH_SSL_SERVER_USE_DEFAULT_CAS and AUTH_SSL_CLIENT_USE_DEFAULT_CAS can be used to disable use of the default CAs for OpenSSL. (HTCONDOR-2090)
When condor_remote_cluster installs binaries on an EL7 machine, it now uses the latest 23.0.x release. Before, it would fail, as current feature versions of HTCondor are not available on EL7. (HTCONDOR-2125)
HTCondor daemons on Linux no longer run very slowly when the ulimit for the maximum number of open files is very high. (HTCONDOR-2128)
Somewhat improved the performance of the
D_FDS. But please don’t use this unless absolutely needed. (HTCONDOR-2050)
HTCondor version 23.1.0 released on October 31, 2023.
This version includes all the updates from Version 23.0.1.
Enterprise Linux 7 support is discontinued with this release.
We have added HTCondor Python wheels for the aarch64 CPU architecture on PyPI. (HTCONDOR-2120)
Improved condor_watch_q to filter tracked jobs based on cluster IDs either provided by the
-clustersoption or found in association to batch names provided by the
-batchesoption. This helps limit the amount of output lines when using an aggregate/shared log file. (HTCONDOR-2046)
The Access Point can now be told to use a non-standard ssh port when sending jobs to a remote scheduling system (such as Slurm). You can now specify an alternate ssh port with condor_remote_cluster. (HTCONDOR-2002)
Laid groundwork to allow an Execution Point running without root access to accurately limit the job’s usage of CPU and Memory in real time via Linux kernel cgroups. This is particularly interesting for glidein pools. Jobs running in cgroup v2 systems can now subdivide the cgroup they have been given, so that pilots can enforce sub-limits of the resources they are given. (HTCONDOR-2058)
HTCondor file transfers using HTTPS can now utilize CA certificates in a non-standard location. The curl_plugin tool now recognizes the environment variable
X509_CERT_DIRand configures libcurl to search the given directory for CA certificates. (HTCONDOR-2065)
Improved performance of condor_schedd, and other daemons, by caching the value in
/etc/localtime, so that debugging logs aren’t always stat’ing that file. (HTCONDOR-2064)