Development Release Series 9.1

This is the development release series of HTCondor. The details of each version are described below.

Version 9.1.3

Release Notes:

  • HTCondor version 9.1.3 released on August 19, 2021.

  • Globus GSI is no longer needed for X.509 proxy delegation

  • GSI is no longer in the list of default authentication methods. To use GSI, you must enable it by setting one or more of the SEC_<access-level>_AUTHENTICATION_METHODS configuration parameters. (HTCONDOR-518)

New Features:

  • The semantics of undefined user job policy expressions has changed. A policy whose expression evaluates to undefined is now uniformly ignored, instead of either putting the job on hold or treated as false. (HTCONDOR-442)

  • Added two new attributes to the job ClassAd, NumHolds and NumHoldsByReason, that are used to provide historical information about how often this job went on hold and why. Details on all job ClassAd attributes, including these two new attributes, can be found in section: Job ClassAd Attributes (HTCONDOR-554)

  • The “ToE tag” entry in the job event log now includes the exit code or signal number, if and as appropriate. (HTCONDOR-429)

  • Docker universe jobs are now run under the built-in docker init process, which means that zombie processes are automatically reaped. This can be turned off with the knob DOCKER_RUN_UNDER_INIT = false (HTCONDOR-462)

  • Many services support the “S3” protocol. To reduce confusion, we’ve added new aliases for the submit-file commands aws_access_key_id_file and aws_secret_access_key_file: s3_access_key_id_file and s3_secret_access_key_file. We also added support for gs://-style Google Cloud Storage URLs, with the corresponding gs_access_key_id_file and gs_secret_access_key_file aliases. This support, and the aliases, use Google Cloud Storage’s “interoperability” API. The HMAC access key ID and secret keys may be obtained from the Google Cloud web console’s “Cloud Storage” section, the “Settings” menu item, under the “interoperability” tab. (HTCONDOR-453)

  • Add new submit command batch_extra_submit_args for grid universe jobs of type batch. This lets the user supply arbitrary command-line arguments to the submit command of the target batch system. These are supplied in addition to the command line arguments derived from other attributes of the job ClassAd. (HTCONDOR-526)

  • When GSI authentication is configured or used, a warning is now printed to daemon logs and the stderr of tools. These warnings can be suppressed by setting configuration parameters WARN_ON_GSI_CONFIGURATION and WARN_ON_GSI_USAGE to False. (HTCONDOR-517)

  • Introduced a new command-line tool, htcondor (see man page) for managing HTCondor jobs and resources. This tool also includes new capabilities for running HTCondor jobs on Slurm machines which are temporarily acquired to act as HTCondor execution points. (HTCONDOR-252)

Bugs Fixed:

  • Fixed a bug where jobs cannot start on Linux if the execute directory is placed under /tmp or /var/tmp. The problem is this breaks the default MOUNT_UNDER_SCRATCH option. As a result, if the administrator located EXECUTE under tmp, HTCondor can no longer make a private /tmp or /var/tmp directory for the job. (HTCONDOR-484)

Version 9.1.2

Release Notes:

  • HTCondor version 9.1.2 released on July 29, 2021.

New Features:

  • None.

Bugs Fixed:

Version 9.1.1

Release Notes:

  • HTCondor version 9.1.1 released on July 27, 2021 and pulled two days later when an issue was found with a patch.

New Features:

  • None.

Bugs Fixed:

Version 9.1.0

Release Notes:

  • HTCondor version 9.1.0 released on May 20, 2021.

  • The condor_convert_history command was removed. (HTCONDOR-392)

New Features:

  • Added support for submission to the ARC CE REST interface via the new grid universe type arc. (HTCONDOR-138)

  • Added a new option in DAGMan to put failed jobs on hold and keep them in the queue when DAGMAN_PUT_FAILED_JOBS_ON_HOLD is True. For some types of transient failures, this allows users to fix whatever caused their job to fail and then release it, allowing the DAG execution to continue. (HTCONDOR-245)

  • gdb and strace now work in Docker Universe jobs. (HTCONDOR-349)

  • The condor_startd on platforms that support Docker now runs a simple Docker container at startup to verify that docker universe completely works. This can be disabled with the knob DOCKER_PERFORM_TEST (HTCONDOR-325)

  • On Linux machines with performance counter support, vanilla universe jobs now report the number of machine instructions executed (HTCONDOR-390)

Bugs Fixed:

  • None.