<commit_before>%%%      PLEASE RUN A SPELL CHECKER BEFORE COMMITTING YOUR CHANGES!
%%%      PLEASE RUN A SPELL CHECKER BEFORE COMMITTING YOUR CHANGES!
%%%      PLEASE RUN A SPELL CHECKER BEFORE COMMITTING YOUR CHANGES!
%%%      PLEASE RUN A SPELL CHECKER BEFORE COMMITTING YOUR CHANGES!
%%%      PLEASE RUN A SPELL CHECKER BEFORE COMMITTING YOUR CHANGES!

%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%
\section{\label{sec:History-8-3}Development Release Series 8.3}
%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%

This is the development release series of HTCondor.
The details of each version are described below.

%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%
\subsection*{\label{sec:New-8-3-3}Version 8.3.3}
%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%

\noindent Release Notes:

\begin{itemize}

\item HTCondor version 8.3.3 released on Feb. 19, 2015.

\end{itemize}


\noindent New Features:

\begin{itemize}

\item Configuration variable \Macro{ENCRYPT\_EXECUTE\_DIRECTORY} 
is now honored on Linux platforms.
The Linux platform must have the  \Prog{ecryptfs-utils} package installed
and the Linux kernel must be version 2.6.29 or a more recent version.
The new submit command \SubmitCmd{encrypt\_execute\_directory} allows the user
to specify directory encryption on a per-job basis.
\Ticket{4856}


\item By default, HTCondor will no longer have access to Linux 
	system credentials, such as OpenAFS tokens or eCryptFS keys.
	This new behavior ensures these credentials cannot be
	unintentionally obtained by user jobs.  
	For more information, see new configuration variable 
	\Macro{DISCARD\_SESSION\_KEYRING\_ON\_STARTUP}
	in section~\ref{param:DiscardSessionKeyringOnStartup}.
\Ticket{4856}

\item \Condor{q} now offers the new command line option \Arg{-autocluster}, 
which causes it to output \Condor{schedd} daemon auto cluster information. 
The information is an ID number and the number of jobs in each auto cluster.
\Ticket{4792}

\item EC2 grid universe jobs may now specify an IAM (instance) profile.
\Ticket{4810}

\item EC2 jobs may now specify security group IDs instead of names.
This allows the use of VPC instances with non-default security groups.
\Ticket{4796}

\item EC2 jobs may now specify additional parameters to use when starting
the corresponding instance.
\Ticket{4795}

\item Improved the preliminary support for IPv4 and IPv6 dual-protocol
submit nodes,
by allowing them to work with the \Condor{shared\_port} daemon.
\Ticket{4712}

\item The throughput of queries to the \Condor{collector} has been
improved, as the \Condor{collector} now never forks to handle queries 
about \Condor{collector}, \Condor{negotiator}, and \Condor{schedd}
ClassAds.
\Ticket{4821}

\item The new configuration variable \Macro{ADD\_SIGNIFICANT\_ATTRIBUTES}
lists job attributes to be added to the \Condor{negotiator}-determined list
when considering auto clustering.
The new configuration variable \Macro{REMOVE\_SIGNIFICANT\_ATTRIBUTES}
lists job attributes to be removed from the \Condor{negotiator}-determined 
list when considering auto clustering.
\Ticket{4797}

\item For all tools that support the \Opt{-format} or \Opt{-autoformat} option,
the new \%r conversion specifier causes values to be displayed 
in their unevaluated, or raw form.
\Ticket{4814}

\item \Condor{dagman} now prints the hold reason to the \File{dagman.out}
file when node jobs go on hold.
\Ticket{4766}

\item New python bindings can be used to query and set the 
configuration variables of running daemons.
\Ticket{4778}

\item Python functions can be invoked directly from ClassAd expressions 
within HTCondor daemons.  
A system administrator must set the new configuration variable
\Macro{CLASSAD\_USER\_PYTHON\_MODULES}
to specify the python modules that are accessible from within ClassAds.
\Ticket{4773}

\item The new Python \texttt{LogReader} class permits the reading and access
of individual daemon log events.
\Ticket{4588}

\item The default value for configuration variable 
\Macro{DAGMAN\_MAX\_JOBS\_IDLE} has changed from 0, 
which imposes no limits, to 1000.
\Ticket{4748}

\item Configuration variable \Macro{DAGMAN\_USE\_OLD\_DAG\_READER}
is no longer supported.  
Setting it to \Expr{True} will result in a warning, 
and the setting will have no effect on how a DAG input file is read.
\Ticket{4186}

\item ClassAd attributes written by the \Condor{schedd} that
count the number of jobs in various states now include all jobs, 
not only jobs that need to be matched by the \Condor{negotiator} daemon.
These attributes include \Attr{TotalRunningJobs}, \Attr{TotalIdleJobs},
\Attr{TotalHeldJobs}, and \Attr{TotalRemovedJobs}.
\Ticket{4683}

\item \Condor{q} and \Condor{history} offer the new command line option 
\Opt{-limit}, 
which limits number of results returned.
\Ticket{4806}

\item A new, more efficient query protocol has been added as the default 
for \Condor{q},
when querying a \Condor{schedd} daemon that is version 8.3.3 or later. 
To disable this new protocol, set configuration variable
\Macro{CONDOR\_Q\_USE\_V3\_PROTOCOL} to \Expr{False}.
\Ticket{4828}

\end{itemize}

\noindent Bugs Fixed:

\begin{itemize}

\item Fixed a bug that prevented CCB servers from running on Windows platforms.
\Ticket{4713}

\item Configuration variables \MacroNI{ENABLE\_IPV4} or 
\MacroNI{ENABLE\_IPV6} may now be safely set in any configuration file. 
Previously, setting them in any file other than the first configuration file 
parsed could have led to unpredictable behavior.
\Ticket{4829}

\item Fixed a bug in the \Condor{startd} daemon introduced in HTCondor 
version 8.3.2.
The \Condor{startd} slots could get stuck
forever in the Preempting/Killing state when they were claimed by 
an HTCondor version 8.3.1 or older \Condor{schedd}.
\Ticket{4807}

\item Fixed an issue introduced in HTCondor version 8.3.0
that could cause the \Condor{schedd} to become unresponsive when a client 
set configuration variable \Macro{CONDOR\_Q\_USE\_V3\_PROTOCOL} 
to its non default value of \Expr{True}.
\Ticket{4805}

\item Configuration variable \Macro{GRACEFULLY\_REMOVE\_JOBS} now
controls how a running job is killed for all cases,
including when a job policy expression causes the job to be held or removed.
Previously, this configuration variable was consulted only 
when the user ran \Condor{hold} or \Condor{rm}.
\Ticket{4679}

\end{itemize}

%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%
\subsection*{\label{sec:New-8-3-2}Version 8.3.2}
%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%

\noindent Release Notes:

\begin{itemize}

\item HTCondor version 8.3.2 released on December 23, 2014.
This version contains all bug fixes from HTCondor version 8.2.6.

\end{itemize}


\noindent New Features:

\begin{itemize}

\item It is now possible run a dual-protocol (IPv4 and IPv6) submit node,
submitting to single-protocol execute nodes. This is preliminary work.
\Ticket{4494}

\item The port used by the \Condor{shared\_port} daemon is now
9618 by default.<commit_msg>Add version history item for 2 8.3.3 known bugs. #4902 #4856<commit_after>%%%      PLEASE RUN A SPELL CHECKER BEFORE COMMITTING YOUR CHANGES!
%%%      PLEASE RUN A SPELL CHECKER BEFORE COMMITTING YOUR CHANGES!
%%%      PLEASE RUN A SPELL CHECKER BEFORE COMMITTING YOUR CHANGES!
%%%      PLEASE RUN A SPELL CHECKER BEFORE COMMITTING YOUR CHANGES!
%%%      PLEASE RUN A SPELL CHECKER BEFORE COMMITTING YOUR CHANGES!

%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%
\section{\label{sec:History-8-3}Development Release Series 8.3}
%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%

This is the development release series of HTCondor.
The details of each version are described below.

%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%
\subsection*{\label{sec:New-8-3-3}Version 8.3.3}
%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%

\noindent Release Notes:

\begin{itemize}

\item HTCondor version 8.3.3 released on Feb. 19, 2015.

\end{itemize}


\noindent New Features:

\begin{itemize}

\item Configuration variable \Macro{ENCRYPT\_EXECUTE\_DIRECTORY} 
is now honored on Linux platforms.
The Linux platform must have the  \Prog{ecryptfs-utils} package installed
and the Linux kernel must be version 2.6.29 or a more recent version.
The new submit command \SubmitCmd{encrypt\_execute\_directory} allows the user
to specify directory encryption on a per-job basis.
\Ticket{4856}


\item By default, HTCondor will no longer have access to Linux 
	system credentials, such as OpenAFS tokens or eCryptFS keys.
	This new behavior ensures these credentials cannot be
	unintentionally obtained by user jobs.  
	For more information, see new configuration variable 
	\Macro{DISCARD\_SESSION\_KEYRING\_ON\_STARTUP}
	in section~\ref{param:DiscardSessionKeyringOnStartup}.
\Ticket{4856}

\item \Condor{q} now offers the new command line option \Arg{-autocluster}, 
which causes it to output \Condor{schedd} daemon auto cluster information. 
The information is an ID number and the number of jobs in each auto cluster.
\Ticket{4792}

\item EC2 grid universe jobs may now specify an IAM (instance) profile.
\Ticket{4810}

\item EC2 jobs may now specify security group IDs instead of names.
This allows the use of VPC instances with non-default security groups.
\Ticket{4796}

\item EC2 jobs may now specify additional parameters to use when starting
the corresponding instance.
\Ticket{4795}

\item Improved the preliminary support for IPv4 and IPv6 dual-protocol
submit nodes,
by allowing them to work with the \Condor{shared\_port} daemon.
\Ticket{4712}

\item The throughput of queries to the \Condor{collector} has been
improved, as the \Condor{collector} now never forks to handle queries 
about \Condor{collector}, \Condor{negotiator}, and \Condor{schedd}
ClassAds.
\Ticket{4821}

\item The new configuration variable \Macro{ADD\_SIGNIFICANT\_ATTRIBUTES}
lists job attributes to be added to the \Condor{negotiator}-determined list
when considering auto clustering.
The new configuration variable \Macro{REMOVE\_SIGNIFICANT\_ATTRIBUTES}
lists job attributes to be removed from the \Condor{negotiator}-determined 
list when considering auto clustering.
\Ticket{4797}

\item For all tools that support the \Opt{-format} or \Opt{-autoformat} option,
the new \%r conversion specifier causes values to be displayed 
in their unevaluated, or raw form.
\Ticket{4814}

\item \Condor{dagman} now prints the hold reason to the \File{dagman.out}
file when node jobs go on hold.
\Ticket{4766}

\item New python bindings can be used to query and set the 
configuration variables of running daemons.
\Ticket{4778}

\item Python functions can be invoked directly from ClassAd expressions 
within HTCondor daemons.  
A system administrator must set the new configuration variable
\Macro{CLASSAD\_USER\_PYTHON\_MODULES}
to specify the python modules that are accessible from within ClassAds.
\Ticket{4773}

\item The new Python \texttt{LogReader} class permits the reading and access
of individual daemon log events.
\Ticket{4588}

\item The default value for configuration variable 
\Macro{DAGMAN\_MAX\_JOBS\_IDLE} has changed from 0, 
which imposes no limits, to 1000.
\Ticket{4748}

\item Configuration variable \Macro{DAGMAN\_USE\_OLD\_DAG\_READER}
is no longer supported.  
Setting it to \Expr{True} will result in a warning, 
and the setting will have no effect on how a DAG input file is read.
\Ticket{4186}

\item ClassAd attributes written by the \Condor{schedd} that
count the number of jobs in various states now include all jobs, 
not only jobs that need to be matched by the \Condor{negotiator} daemon.
These attributes include \Attr{TotalRunningJobs}, \Attr{TotalIdleJobs},
\Attr{TotalHeldJobs}, and \Attr{TotalRemovedJobs}.
\Ticket{4683}

\item \Condor{q} and \Condor{history} offer the new command line option 
\Opt{-limit}, 
which limits number of results returned.
\Ticket{4806}

\item A new, more efficient query protocol has been added as the default 
for \Condor{q},
when querying a \Condor{schedd} daemon that is version 8.3.3 or later. 
To disable this new protocol, set configuration variable
\Macro{CONDOR\_Q\_USE\_V3\_PROTOCOL} to \Expr{False}.
\Ticket{4828}

\end{itemize}

\noindent Bugs Fixed:

\begin{itemize}

\item Fixed a bug that prevented CCB servers from running on Windows platforms.
\Ticket{4713}

\item Configuration variables \MacroNI{ENABLE\_IPV4} or 
\MacroNI{ENABLE\_IPV6} may now be safely set in any configuration file. 
Previously, setting them in any file other than the first configuration file 
parsed could have led to unpredictable behavior.
\Ticket{4829}

\item Fixed a bug in the \Condor{startd} daemon introduced in HTCondor 
version 8.3.2.
The \Condor{startd} slots could get stuck
forever in the Preempting/Killing state when they were claimed by 
an HTCondor version 8.3.1 or older \Condor{schedd}.
\Ticket{4807}

\item Fixed an issue introduced in HTCondor version 8.3.0
that could cause the \Condor{schedd} to become unresponsive when a client 
set configuration variable \Macro{CONDOR\_Q\_USE\_V3\_PROTOCOL} 
to its non default value of \Expr{True}.
\Ticket{4805}

\item Configuration variable \Macro{GRACEFULLY\_REMOVE\_JOBS} now
controls how a running job is killed for all cases,
including when a job policy expression causes the job to be held or removed.
Previously, this configuration variable was consulted only 
when the user ran \Condor{hold} or \Condor{rm}.
\Ticket{4679}

\end{itemize}

\noindent Known Bugs:

\begin{itemize}

\item The ability to transparently encrypt execute directories
is not supported by execute hosts using RHEL 7 and derivative kernels,
as these kernels no longer contain the \Prog{eCryptfs} kernel module.

\item  The submit commands 
\SubmitCmd{on\_exit\_hold} and \SubmitCmd{on\_exit\_remove}  
do not do what they are supposed to do
for local universe jobs on Windows machines.
\Ticket{4902}
\end{itemize}


%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%
\subsection*{\label{sec:New-8-3-2}Version 8.3.2}
%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%

\noindent Release Notes:

\begin{itemize}

\item HTCondor version 8.3.2 released on December 23, 2014.
This version contains all bug fixes from HTCondor version 8.2.6.

\end{itemize}


\noindent New Features:

\begin{itemize}

\item It is now possible run a dual-protocol (IPv4 and IPv6) submit node,
submitting to single-protocol execute nodes. This is preliminary work.
\Ticket{4494}

\item The port used by the \Condor{shared\_port} daemon is now
9618 by default.
{'fraction_non_alphanumeric': 0.12740580103008944, 'fraction_numerical': 0.024600162645703444, 'mean_word_length': 4.771216269065311, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 3, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 2, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '7468410', 'n_tokens_mistral': 4632, 'n_tokens_neox': 4323, 'n_words': 1782}