Version 25.0 LTS Releases

These are Long Term Support (LTS) versions of HTCondor. As usual, only bug fixes (and potentially, ports to new platforms) will be provided in future 25.0.y versions. New features will be added in the 25.x.y feature versions.

The details of each version are described below.

Version 25.0.11

Release Notes:

  • HTCondor version 25.0.11 released on June 11, 2026.

New Features:

  • HTCondor tarballs now contain Pelican 7.25.0

  • The condor package now requires pelican-7.25.0.

  • HTCondor tarballs now contain Apptainer 1.5.0

  • The condor RPM package now requires at least apptainer version 1.5.0.

Bugs Fixed:

  • Fixed an infrequent crash in the condor_startd that occurred when users installed a custom docker wrapper script. (HTCONDOR-3691)

  • It was possible for docker universe jobs to generate duplicate volume mounts. We now remove duplicates before invoking docker. (HTCONDOR-3702)

  • Fixed a rare issue where condor_dagman would unnecessarily abort after reboot of the host machine due to operating system process ID (PID) reuse. (HTCONDOR-3739)

  • When the python bindings are run as user root and use the FS method to authenticate with a daemon, the authenticated identity will be condor instead of root. This matches the behavior of all of the command line tools. (HTCONDOR-3695)

  • If a job terminates with a named pipe in the sandbox, it will no no longer hang transferring output. (HTCONDOR-3743)

  • Fixed a bug introduced in 24.0.18 where new STARTD_CRON values weren’t incorporated into the condor_startd’s internal slot ads for several minutes, though those ads were sent to the condor_collector immediately. (HTCONDOR-3709)

  • Fixed a bug where the job lease duration was based on when the TCP connection to the EP was lost, when it should be based on the last time a message was successfully exchanged with the EP. (HTCONDOR-3724)

Version 25.0.10

Release Notes:

  • HTCondor version 25.0.10 released on May 14, 2026.

New Features:

  • Add Ubuntu 26.04 (Resolute Raccoon) support. (HTCONDOR-3703)

  • HTCondor tarballs now contain Pelican 7.24.2

  • The condor package now requires pelican-7.24.2.

Bugs Fixed:

  • Fixed a bug that caused attempts to refresh a job’s X.509 proxy file spooled by the AP to fail. (HTCONDOR-3660)

  • htcondor2.param now properly handles configuration options typed as long integers containing values greater than approximately 2 billion and no longer crashes the process when accessing the param object. (HTCONDOR-3616)

  • Improved messages in STARTD_LOG when the condor_startd aborts due to failing to detect the total amount of physical memory or when RESERVED_MEMORY leaves no memory for slot creation. (HTCONDOR-3667)

  • Fixed a bug in the parallel universe where the job attribute RemoteUserCpu would only contain the cpu usage from one proc in the parallel job. (HTCONDOR-3677)

  • condor_ssh_to_job now properly supports running into docker and container universe jobs with a one-shot command argument. In addition, the shell now enters the cgroup of the job for container universe jobs. (HTCONDOR-3658)

  • Fixed bug where Execution Points using STARTD_ENFORCE_DISK_LIMITS without being explicitly provided a backing store (Volume Group) would fail clean up to clean up the automatically generated backing store on shutdown. (HTCONDOR-3657)

  • VM Universe jobs now use the widely supported and ubiquitous Intel e1000 network card. This is needed on Enterprise Linux 10 hosts, where the default virtual NIC model selected by libvirt is incompatible. (HTCONDOR-3642)

Version 25.0.9

Release Notes:

  • HTCondor version 25.0.9 released on April 16, 2026.

New Features:

  • HTCondor tarballs now contain Pelican 7.24.0

  • The condor package now requires pelican-7.24.0.

Bugs Fixed:

  • Fixed a bug that would cause the condor_startd to crash if a custom DOCKER docker wrapper emitted unexpected output to the “images” sub-command. (HTCONDOR-3596)

  • Fixed a bug where condor_status would not adjust the Name column width to fit data for some output formats. This bug would result in columns after the Name column not being properly aligned when the longest name exceeded 34 characters. (HTCONDOR-3255)

  • Fixed a bug where condor_vacate would fail to find the address of the condor_startd when provided a slot name. With this change the condor_collector now searches through both Startd Daemon Ads and Startd Slot Ads when handling a locate query. (HTCONDOR-3580)

  • Fixed a bug in condor_q match analysis that would always count sub-expressions that evaluated to a double or integer as not matching. (HTCONDOR-3601)

  • Fixed a bug where an NVIDIA GPU that has been subdivided in MIG sub-devices would not properly pass the device names in the various NVIDIA related environment variables. (HTCONDOR-3567)

  • Fixed a performance problem with the classad2 python bindings that caused the parseAds methods to run in n-squared time. (HTCONDOR-3632)

  • Fixed a bug where allowed_execute_duration would possibly not be respected for jobs that did not do input file transfer. (HTCONDOR-3633)

  • Fixed a bug for batch grid universe jobs where submitting to a remote system would fail if the username on the remote system contained a dot. (HTCONDOR-3581)

  • Fixed a bug where some of the values reported for job execution time were enormous if the Access Point daemons restarted while the job was running. (HTCONDOR-3592)

  • Fixed a bug where an administrator couldn’t query a daemon’s configuration using condor_config_val when authentication is required for READ level authorization. (HTCONDOR-3572)

  • The htcondor2.send_command() method no longer incorrectly requires a target parameter. (HTCONDOR-3597)

Version 25.0.8

Release Notes:

  • HTCondor version 25.0.8 released on March 12, 2026.

New Features:

  • Enable the in-memory cache option in newer versions of the scitokens-cpp library. This allows the library to continue operating when the on-disk cache is not useable. (HTCONDOR-3560)

  • HTCondor tarballs now contain Pelican 7.23.0

  • The condor package now requires pelican-7.23.0.

Bugs Fixed:

  • Improve AMD GPU detection when using ROCM6/HIP libraries and fix a potential crash when using the HIP libraries with the default detection options passed by the condor_startd. (HTCONDOR-3533)

  • Fixed issue where jobs could match Execution Points utilizing STARTD_ENFORCE_DISK_LIMITS only for them to immediately be kicked off due to unavailable disk space due to quantization issues between HTCondor and LVM. This would could cause lots of unnecessary job churn when Execution Points are very busy. (HTCONDOR-3490)

  • Fixed a bug where an job with a circular Requirements expression would result in a crash in condor_q when the -better option was passed. The crash was fixed, and condor_submit was changed to report an error when the submit file has a requirements command that references Requirements. (HTCONDOR-2629)

  • Fixed a bug in condor_status where the Offline-GPUs column of the -gpus output was always empty. (HTCONDOR-3558)

  • Fixed a bug in htcondor2.Schedd.history() which prevented its since argument from being the string representation of an expression. (HTCONDOR-3435)

  • Fixed a bug where a backfill p-slot would have no assigned GPUs after a reconfig. (HTCONDOR-3072)

  • Fixed a bug in condor_submit that could expand the executable path incorrectly when using late materialization and a different executable for each job. (HTCONDOR-3546)

  • Fixed a bug where new STARTD_CRON values didn’t trigger an immediate update of slot ads to the collector when configured to do so. (HTCONDOR-3526)

  • Update Annex’s knowledge about the Delta HPC system. (HTCONDOR-3559)

Version 25.0.7

Release Notes:

  • HTCondor version 25.0.7 released on February 12, 2026.

New Features:

  • None.

Bugs Fixed:

Version 25.0.6

Release Notes:

  • HTCondor version 25.0.6 released on January 29, 2026.

New Features:

  • Initial support for openSUSE Leap 16. (HTCONDOR-3233)

  • Strip out VOMS and EC2 GAHP support in the HTCondor Python wheels, so that the HTCondor Python wheel is usable with the python-slim Docker image. (HTCONDOR-3469)

  • HTCondor tarballs now contain Pelican 7.22.0

  • The condor package now requires pelican-7.22.0.

  • HTCondor tarballs now contain Apptainer 1.4.5

  • The condor RPM package now requires at least apptainer version 1.4.5.

Bugs Fixed:

  • Fixed a bug where specifying a scope or audience when storing a Vault-managed credential results in a stored token that can’t be used. (HTCONDOR-3506)

  • In the condor_schedd when a transform attempts to set an immutable attribute more than once, the second attempt be quietly ignored rather than failing job materialization. (HTCONDOR-3495)

  • Fixed a bug where a backfill p-slot could get into a state where it would advertise that it had capacity, but refuse every claim with a log message indicating that it had zero CPUs. (HTCONDOR-3072)

  • Fixed a bug in the shared-port daemon that caused new network connections to fail if only a few bytes are immediately available to read. (HTCONDOR-3420)

  • Fixed a bug where a job with a floating point value for RequestMemory or RequestDisk might not match the slot created to run it. (HTCONDOR-3423)

  • Fixed a bug that would cause a crash in the condor_rooster and condor_defrag when many slots would have identical ROOSTER_UNHIBERNATE_RANK expressions, or if was not constant (e.g. used random() or time()). (HTCONDOR-3436)

  • Removed memory leak from htcondor2.JobEventLog.events(). (HTCONDOR-3474)

  • Changed condor_history so that when it prints jobs in -long format it prints them with attributes sorted alphabetically like condor_q does. (HTCONDOR-3481)

  • Fix Logical Volume setup timeout on Execution Points enforcing disk usage for jobs that have a large request_disk value (800+ GB). (HTCONDOR-3432)

  • Fixed issue with Execution Points enforcing disk usage generating an excessive amount of metadata archives filling up /etc/lvm/archive. (HTCONDOR-3488)

  • Added FILETRANSFER_PLUGIN_CLASSAD_TIMEOUT for administrators to set a longer timeout for plugins to detect their health. (HTCONDOR-3455)

  • Fixed a bug where docker universe jobs would bring back a file named .docker_stderror back to the AP after job completion. (HTCONDOR-3424)

  • Fixed a bug where the values of the attributes LocalJobsIdle and LocalJobsRunning in the submitter ad were reversed. (HTCONDOR-3456)

Version 25.0.5

Release Notes:

  • HTCondor version 25.0.5 released on December 15, 2025.

New Features:

Bugs Fixed:

  • Improve compatibility with versions of HTCondor that attempt to set attribute OsUser in the job ad. (HTCONDOR-3415)

  • Calling Schedd.submit() with a list of dictionaries with dissimilar keys will no longer mangle the values (and instead ignore the extra keys, as implied by the documentation). (HTCONDOR-3351)

  • Fixed a bug that could cause the AP to fail to read job credential files. (HTCONDOR-3377)

  • Fixed bugs that could cause a crash in the authentication code. (HTCONDOR-3394)

  • Fixed a bug where the condor_negotiator would fail to contact the condor_schedd to perform matchmaking if its ALLOW_CLIENT configuration parameter didn’t authorize the identity submit-side@matchsession. (HTCONDOR-3378)

  • Fixed a bug where tools like condor_status would print an incorrect value for the -af:r option when the value to be printed was a single attribute reference. (HTCONDOR-3347)

Version 25.0.3

Release Notes:

  • HTCondor version 25.0.3 released on November 3, 2025.

New Features:

  • Added a new EP configuration knob, DOCKER_TRUST_LOCAL_IMAGES which defaults to false. Setting this to true allows users to run docker images which have been pre-staged in the EPs docker cache even if the image does not exist in a repository, or if the user does not have permission to pull from that repository. (HTCONDOR-3315)

  • The condor_schedd will now include the address of a condor_credd that is running under the same condor_master in its ClassAd and address file. This allows the submission process to get the the address of the condor_credd from the condor_schedd for some situations where credentials must be stored as part of job submission. The Kerberos local issuer will now use this mechanism and no longer query the collector for the address of the condor_credd. (HTCONDOR-3281)

Bugs Fixed:

  • Fix interoperability problem between HTCondor-CE 24 and 25 which manifests as a Job Router crash when upgrading the CE to HTCondor 25 (HTCONDOR-3355)

  • Fixed a bug in Schedd.submit() where single-entry itemdata could be truncated to its first character. (HTCONDOR-3272)

  • Fixed a bug in Schedd.submit() where the $(step) submit variable wasn’t being set. (HTCONDOR-3272)

  • Fixed a bug in Submit.itemdata() causing multi-entry itemdata to be returned incorrectly. (HTCONDOR-3272)

  • Fixed a bug where using max_idle, container_image and transfer_input_files could result in the container only being transferred along with the first job. (HTCONDOR-3092)

  • Changed the documentation for classad2.ClassAd.matches() and classad2.ClassAd to match their implementations; the original documentation was in error, and both are actually backwards-compatible with the first version of the Python bindings. Made other minor changes; see the ticket for details. (HTCONDOR-3328)

  • Calling classad2.ExprTree(None) no longer results in an invalid classad2.ExprTree, preventing segmentation faults when using the object. (HTCONDOR-3319)

  • Fixed a bug where condor_history could take many minutes to read a single line from the history file when the line is many megabytes long. This was causing ingestion of epoch ads into a database to timeout. (HTCONDOR-3299)

  • Fixed a bug where if input file transfer failed, occasionally no descriptive error message about the failure would make it back into the job hold reason. (HTCONDOR-3327)

  • Fixed a very longstanding bug where extremely fast machines would overflow a 32 bit counter and return -1 for the KFlops slot attribute. (HTCONDOR-3288)

  • The gpu and gpu-debug queues at Anvil are no longer represented in htcondor annex as whole-node queues, fixing a problem where the “whole node” would have 4 GPUs and only 1 CPU. (HTCONDOR-3324)

  • Fix problem running PyTorch jobs on multiple GPUs with newer versions of the CUDA library by providing long GPU IDs in the CUDA_VISIBLE_DEVICES environment variable (HTCONDOR-3350)

  • Calling htcondor2.Schedd.history() on an object whose corresponding daemon can’t be contacted will no longer cause a segmentation fault. (HTCONDOR-3314)

  • Executions points using disk enforcement failed when provided backing LVM_VOLUME_GROUP_NAME and LVM_THINPOOL_NAME contained hyphens. (HTCONDOR-3334)

  • Add a timeout for all HTTP operations in the grid universe (affects arc, ec2, and gce grid types). (HTCONDOR-3300)

  • Fixed a bug where administrative tools (e.g. condor_drain) can fail if authentication is not required for queries to the condor_collector. (HTCONDOR-3301)

  • The condor_startd now correctly removes docker containers that have escaped from docker universe jobs launched by condor_starter's that have exited uncleanly. (HTCONDOR-3338)

  • Annexes no longer download a default configuration tarball, making them more robust. This required upgrading the default version of HTCondor run by annexes to 25.1.0, which can figure the details out on its own. On Delta, annexes now give Delta additional time to start file-transfer plug-ins, so they should be more-reliably available there. (HTCONDOR-3220)

  • condor_adstash no longer skips entire history files when it encounters a line that cannot be decoded to UTF-8. (HTCONDOR-3335)

  • Fixed a bug in blahpd when /tmp is mounted with the noexec option. (HTCONDOR-3343)

Version 25.0.2

Release Notes:

  • HTCondor version 25.0.2 released on October 9, 2025.

New Features:

  • HTCondor tarballs now contain Pelican 7.20.2

  • The condor package now requires pelican-7.20.2.

Bugs Fixed:

  • Fixed a bug causing some file-transfer plug-ins (box, gdrive, and onedrive) to fail immediately on start-up. (HTCONDOR-3317)

  • Fixed bug where when SINGULARITY_TARGET_DIR was set and STARTER_NESTED_SCRATCH was also set, then some environment variables that pointed into the job’s execute directory were not correct. (HTCONDOR-3265)

  • Fixed bug where the message Processing new events... would briefly flash while running condor_watch_q (HTCONDOR-3244)

  • Fixed a bug where space and comma would be included in the list of separators for itemdata even if the itemdata had been supplied with the ASCII “unit separator”. This would cause itemdata entries containing spaces (or commas) to be incorrectly interpreted as multiple items, which could manifest as parse errors. You can work around this bug if only one of your entries has spaces and/or commas by moving that entry to the end of the line (or dictionary, if you’re submitting itemdata via Python). (HTCONDOR-3272)

  • Fixed false positive reporting of ClassAd unit specifier test in condor_upgrade_check. (HTCONDOR-3276)

Version 25.0.1

Release Notes:

  • HTCondor version 25.0.1 released on September 29, 2025.

New Features:

  • New implementations of the Python bindings, htcondor2 and classad2. This re-implementation of the Python bindings fixes short-comings in the original implementation and eases future maintenance. (HTCONDOR-2153)

  • The original implementation of the Python bindings has been removed. To use the new Python bindings, please read the migration guide. (HTCONDOR-3240)

  • Updated condor_upgrade_check to test for well known gotchas between v24 and v25 of HTCondor installations. (HTCONDOR-3209)

  • HTCondor tarballs now contain Pelican 7.19.3

  • The condor package now requires pelican-7.19.3.

  • The condor RPM package now requires at least apptainer version 1.4.2.

Bugs Fixed:

  • Fixed a bug where condor_qusers would treat the add option as enable when the leading dash was omitted. (HTCONDOR-3284)

  • Fixed a bug where the blahpd would fail when using Python 3.12 or later. (HTCONDOR-3225)

  • Fixed bug where jobs held due to exceeding disk usage had the same HoldReasonCode and HoldReasonSubCode as jobs that exceeded memory usage. (HTCONDOR-3248)

  • Fixed a bug where Flock Collectors could be forgotten after having a connection interruption. (HTCONDOR-3200)

  • Fixed a bug where a condor_schedd would not attempt to flock to collectors in the FLOCK_TO list when a communication failure occurred to a collector earlier in the list. (HTCONDOR-3200)

  • Fixed a packaging bug in tarballs for RPM-based systems which resulted in the Pelican file-transfer plug-in not being enabled by default. (HTCONDOR-3239)