Byte Pair Encoding is Suboptimal for Language Model Pretraining

Abstract: The success of pretrained transformer language models (LMs) in natural language processing has led to a wide range of pretraining setups. In particular, these models employ a variety of subword tokenization methods, most notably byte-pair encoding (BPE) (Sennrich et al., 2016; Gage, 1994), the WordPiece method (Schuster and Nakajima, 2012), and unigram language modeling (Kudo, 2018), to segment text. However, to the best of our knowledge, the literature does not contain a direct evaluation of the impact of tokenization on language model pretraining. We analyze differences between BPE and unigram LM tokenization, finding that the latter method recovers subword units that align more closely with morphology and avoids problems stemming from BPE's greedy construction procedure. We then compare the fine-tuned task performance of identical transformer masked language models pretrained with these tokenizations. Across downstream tasks and two languages (English and Japanese), we find that the unigram LM tokenization method matches or outperforms BPE. We hope that developers of future pretrained LMs will consider adopting the unigram LM method over the more prevalent BPE.

\section{Introduction}
Large transformers \citep{vaswani2017attention} pretrained with variants of a language modeling objective, such as \textsc{BERT} \citep{devlin2019bert}, have proven their effectiveness at flexibly transferring to a variety of domains and tasks. One design decision that makes them particularly adaptable is their graceful handling of the open vocabulary problem through subword tokenization. Subword tokenization, popularized in the neural machine translation literature \citep{sennrich-etal-2016-neural, vaswani2017attention, wu2016google}, produces tokens at multiple levels of granularity, from individual characters to full words. As a result, rare words are broken down into a collection of subword units, bottoming out in characters in the worst case.

Critically, a pretrained language model's subword vocabulary cannot be altered: any downstream application of these models must tokenize input or generate output using the original subword vocabulary, making the choice of tokenization a particularly significant decision.

A variety of subword tokenization methods have seen use in pretrained language models. \textsc{BERT} uses the WordPiece method \citep{Schuster2012JapaneseAK}, a language-modeling based variant of BPE;
T5 \citep{raffel2019exploring} uses character-level BPE;
\textsc{GPT2} \citep{radford2019language} and \textsc{RoBERTa} \citep{liu2019roberta} use BPE over raw bytes instead of unicode characters;
\textsc{XLNet} \citep{yang2019xlnet} and \textsc{ALBERT} \citep{lan2019albert} use the SentencePiece library \citep{kudo-richardson-2018-sentencepiece} which implements both BPE and unigram language model tokenization, but in both cases fail to clarify which of these methods they chose. The effects of tokenization are not examined in a reported experiment in any of the above works except \citet{liu2019roberta}, who note that WordPiece gave a small advantage over BPE in their preliminary investigation. In the machine translation literature, \citet{kudo-2018-subword} introduced the unigram language model tokenization method in the context of machine translation and found it comparable in performance to BPE. \citet{domingo2018much} performed further experiments to investigate the effects of tokenization on neural machine translation, but used a shared BPE vocabulary across all experiments. \citet{galle-2019-investigating} examined algorithms in the BPE family, but did not compare to unigram language modeling.

In this work, we characterize the space of proposed subword tokenization algorithms and analyze the differences between the two methods with publicly available implementations: BPE (merging tokens based on bigram frequency) and unigram language modeling (pruning tokens based on unigram LM perplexity). While the vocabularies resulting from these schemes are heavily overlapping, we compare each method to reference morphological segmentations and find that the unigram LM method produces tokens better aligned with morphology. To understand whether this more natural tokenization leads to improved performance, we pretrain separate language models using the \textsc{RoBERTa} objective \cite{liu2019roberta} with each tokenization for both English and Japanese, two typologically distant languages. On downstream tasks, we find a performance gap across tasks and languages, with the unigram LM method providing an improvement over BPE of up to 10\% in our Japanese QA experiments, indicating the benefits of adopting this technique in the context of language model pretraining.

\section{Algorithms}

Subword tokenization algorithms consist of two components: a vocabulary construction procedure, which takes a corpus of text and returns a vocabulary with the desired size, and a tokenization procedure, which takes the built vocabulary and applies it to new text, returning a sequence of tokens. In theory, these two steps can be independent, although for the algorithms we examine the tokenization procedure is tightly coupled to the vocabulary construction procedure.

A BPE vocabulary is constructed as follows:

\begin{algorithm}
\caption{Byte-pair encoding \citep{sennrich-etal-2016-neural, Gage1994NAD}}\label{bpe}
\begin{algorithmic}[1]
\State Input: set of strings $D$, target vocab size $k$
\Procedure{BPE}{$D, k$}
\State $V \gets$ all unique characters in $D$
\State \hspace{2em} (about 4,000 in English Wikipedia)
\While{$|V| < k$} \Comment{Merge tokens}
    \State $t_L, t_R \gets $ Most frequent bigram in $D$
    \State $t_\textsc{new} \gets t_L + t_R$ \Comment{Make new token}
    \State $V \gets V + \lbrack t_\textsc{new} \rbrack$
    \State Replace each occurrence of $t_L, t_R$ in
    \State \hspace{1em} $D$ with $t_\textsc{new}$
\EndWhile
\State \textbf{return} $V$
\EndProcedure
\end{algorithmic}
\end{algorithm}

BPE tokenization takes the vocabulary $V$ containing ordered merges and applies them to new text in the same order as they occurred during vocabulary construction.

The WordPiece algorithm \citep{Schuster2012JapaneseAK}, used to construct BERT's vocabulary, closely resembles BPE. However, instead of merging the most frequent token bigram, each potential merge is scored based on the likelihood of an $n$-gram language model trained on a version of the corpus incorporating that merge.
\citet{Schuster2012JapaneseAK} note that the process of estimating language model parameters for every potential merge is prohibitive, so they employ aggressive heuristics to reduce the number of potential merges considered. As their implementation is not public,\footnote{Although its name and association with Google might suggest otherwise, the SentencePiece library \citep{kudo-richardson-2018-sentencepiece} does not, in fact, implement the WordPiece algorithm; it provides implementations of BPE and unigram LM based tokenization.} we are unable to make a comparison to this method.

The unigram LM method \citep{kudo-2018-subword}, in contrast to the bottom-up construction process of BPE and WordPiece, begins with a superset of the final vocabulary, pruning it to the desired size:
\begin{algorithm}
\caption{Unigram LM \citep{kudo-2018-subword}}\label{unigram}
\begin{algorithmic}[1]
\State Input: set of strings $D$, target vocab size $k$
\Procedure{UnigramLM}{$D, k$}
\State $V \gets$ all substrings occurring more than
\State \hspace{2em} once in $D$ (not crossing words)
\While{$|V| > k$} \Comment{Prune tokens}
    \State Fit unigram LM $\theta$ to $D$
    \For{$t \in V$} \Comment {Estimate token `loss'}
        \State $L_t \gets p_{\theta}(D) - p_{\theta'}(D)$
        \State where $\theta'$ is the LM without token $t$
    \EndFor
    \State Remove $\min (|V|-k, \lfloor \alpha |V| \rfloor )$ of the
    \State tokens $t$ with highest $L_t$ from $V$,
    \State where $\alpha \in \lbrack0, 1\rbrack$ is a hyperparameter
\EndWhile
\State Fit final unigram LM $\theta$ to $D$
\State \textbf{return} $V, \theta$
\EndProcedure
\end{algorithmic}
\end{algorithm}

\begin{figure*}[!t]
\small
    \centering
    \begin{tabular}{r l}
        \textbf{Original:} & furiously \\
        \textbf{BPE:} & \texttt{\_fur iously} \\
        \vspace{1ex}\textbf{Uni. LM:} & \texttt{\_fur ious ly} \\
    \end{tabular}
    \begin{tabular}{r l}
        \textbf{Original:} & tricycles \\
        \textbf{BPE:} & \texttt{\_t ric y cles} \\
        \vspace{1ex}\textbf{Uni. LM:} & \texttt{\_tri cycle s} \\
    \end{tabular}
    \begin{tabular}{r l}
        \textbf{Original:} & nanotechnology \\
        \textbf{BPE:} & \texttt{\_n an ote chn ology} \\
        \vspace{1ex}\textbf{Uni. LM:} & \texttt{\_nano technology}
    \end{tabular}
    \begin{tabular}{r l}
        \textbf{Original:} & \texttt{Completely preposterous suggestions} \\
        \textbf{BPE:} & \texttt{\_Comple t ely \_prep ost erous \_suggest ions} \\
        \vspace{1ex}\textbf{Unigram LM:} & \texttt{\_Complete ly \_pre post er ous \_suggestion s}
    \end{tabular} \\
    \begin{tabular}{l r}
        \begin{tabular}{@{}r l}
            \textbf{Original:} & \texttt{corrupted} \\
            \textbf{BPE:} & \texttt{\_cor rupted} \\
            \vspace{1ex}\textbf{Unigram LM:} & \texttt{\_corrupt ed}
        \end{tabular}
        &
        \begin{tabular}{r l@{}}
            \textbf{Original:} & \texttt{1848 and 1852,} \\
            \textbf{BPE:} & \texttt{\_184 8 \_and \_185 2,} \\
            \vspace{1ex}\textbf{Unigram LM:} & \texttt{\_1848 \_and \_1852 ,}
        \end{tabular}
    \end{tabular} \\

    \begin{tabular}{r l l l l l l l}
        \textbf{Original} & \multicolumn{7}{l}{\ja{磁性は様々に分類がなされている。}} \\
        \textbf{BPE} & \multicolumn{2}{l}{\ja{磁　性は}} & \ja{様々} & \multicolumn{2}{l}{\ja{に分類}} & \ja{がなされている} & \ja{。} \\
        \textbf{Unigram LM} & \ja{磁　性} & \ja{は} & \ja{様々} & \ja{に} & \ja{分類} & \ja{がなされている} & \ja{。}\\
        \textbf{Gloss} & magnetism & (top.) & various ways & in & classification & is done & . \\
        \textbf{Translation} & \multicolumn{6}{l}{Magnetism is classified in various ways.}
    \end{tabular}

    \caption{Example tokenizations. The character `\_' is a word boundary marker. BPE merges common tokens, such as English inflectional suffixes and Japanese particles, into their neighbors even when the resulting unit is not semantically meaningful.}
    \label{fig:examples}
\end{figure*}

\begin{figure*}[!t]
\small
    \centering
    \begin{subfigure}[b]{\columnwidth}
        \includegraphics{fig_token_lengths.pdf}
        \caption{Token length distributions within each vocabulary}
        \label{fig:token_lengths}
    \end{subfigure}
    \begin{subfigure}[b]{\columnwidth}
        \includegraphics{fig_token_freqs.pdf}
        \caption{Token frequency profiles over the corpus}
        \label{fig:token_freqs}
    \end{subfigure}
    \caption{English subword vocabulary and corpus profiles. The unigram LM method produces longer tokens on average (a) and uses its vocabulary space more effectively (b), with more tokens of moderate frequency.}
\end{figure*}

Unigram LM tokenization takes the vocabulary $V$ and unigram LM parameters $\theta$ and performs Viterbi inference to decode the segmentation with maximum likelihood under $\theta$. This method is similar to Morfessor's unsupervised segmentation \cite{creutz2005unsupervised} without its informed prior over token length.

In the course of our experiments we did not observe a major difference in speed between the two algorithms. Both require similar amounts of time to construct a vocabulary, and both have a negligible impact on overall model inference latency.

\section{Comparison of Segmentations}

\subsection{Morphology}

In Figure \ref{fig:examples} we illustrate the differences in tokenization output between BPE and the unigram LM method. We observe that the unigram LM method produces subword units that qualitatively align with morphology much better than those produced by BPE.
In particular, we note that the unigram LM method recovers common affixes such as \emph{-ly}, \emph{-s}, \emph{pre-}, and \emph{tri-} while BPE does not, instead absorbing them into adjacent units (\emph{-cles}) while also producing meaningless single-character units.

\begin{table}[!t]
\small
    \centering
    \begin{tabular}{c c} \toprule
        \multicolumn{2}{c}{\textbf{More frequent in}} \\
        BPE & Unigram LM \\ \midrule
        \begin{tabular}{@{}c c c c c}
        \_H & \_L & \_M & \_T & \_B \\
        \_P & \_C & \_K & \_D & \_R
        \end{tabular} &
        \begin{tabular}{c c c c c@{}}
        s & . & , & ed & d \\
        ing & e & ly & t & \_a
        \end{tabular} \\
        \bottomrule
    \end{tabular}
    \caption{Tokens with the highest difference in frequency between tokenizations. The unigram LM method tends to produce more parsimonious prefixes and suffixes.}
    \label{tab:max_diff}
\end{table}

\begin{table}[!t]
\small
    \centering
    \begin{tabular}{l c c} \toprule
         & \multicolumn{2}{c}{\textbf{Tokenization}} \\
         & BPE & Unigram LM \\ \midrule
        Tokens per word type & 4.721 & 4.633 \\
        Tokens per word & 1.343 & 1.318 \\ \bottomrule
    \end{tabular}
    \caption{Mean subword units per word for each method across all of English Wikipedia.}
    \label{tab:vocab_stats}
\end{table}

\begin{table*}[!t]
\small
    \centering
    \begin{tabular}{l c c c c c c}\toprule
    \multirow{2}{*}{\textbf{Method}} & \multicolumn{3}{c}{\textbf{English (w.r.t. CELEX2)}} & \multicolumn{3}{c}{\textbf{Japanese (w.r.t. MeCab)}} \\
    & Precision & Recall & F1 & Precision & Recall & F1 \\ \midrule
    BPE & 38.6\% & 12.9\% & 19.3\% & 78.6\% & 69.5\% & 73.8\% \\
    Uni. LM & 62.2\% & 20.1\% & 30.3\% & 82.2\% & 72.8\% & 77.2\% \\ \bottomrule

    \end{tabular}
    \caption{Correspondence of subword boundaries between unsupervised tokenization methods and morphological reference segmentations.}
    \label{tab:quant_morph}
\end{table*}

This trend is supported by Table \ref{tab:max_diff}, in which we observe that recognizable affixes appear much more frequently in the unigram LM tokenization of our pretraining corpus than in the BPE tokenization.
As the BPE tokenization is constructed greedily according to frequency, common affixes (and punctuation) are frequently absorbed into other tokens.\footnote{Note that the BPE vocabulary still includes these affixes, but when they are encountered during tokenization, they are almost always merged into larger units as in Figure~\ref{fig:examples}.}

We see in Figure \ref{fig:token_lengths} that the unigram LM tokenization tends to have longer subword units than BPE. This is closer to the length distribution of gold-standard English morphs, which have a mean length of approximately 6 characters \citep{creutz2004morpheme}.

\paragraph{Comparison with morphological segmenters} In Table \ref{tab:quant_morph}, we further corroborate these observations by performing a quantitative evaluation of the degree to which each unsupervised segmentation algorithm aligns with morphological baselines for each language. For English, we produce gold surface allomorph boundaries from the CELEX2 lexical database \citep{celex2} in the manner of \citet{hutmegs}. We then compare each algorithm's subword unit boundaries with gold morpheme boundaries for words with 2 or more morphemes, weighted by their frequency in English Wikipedia. For Japanese, we compare subword tokenizations of Japanese Wikipedia sentences to morphological reference tokenizations produced using the MeCab morphological analysis and tokenization tool \citep{mecab} using version 2.3.0 of the UniDic dictionary \citep{unidic}.

We find that for both languages, the segmentations produced by the unigram LM method correspond more closely to the morphological references, confirming our qualitative analysis. On English data, both unsupervised methods exhibit low boundary recall; we attribute this to the fact that they represent many common words with underlying derivational morphology as single tokens, although for BPE this is compounded by effects we discuss in Section 3.2.

The ability of the unigram LM method to recover the morphological structure of the text without explicit supervision aligns with the main findings of \citet{creutz2005unsupervised}, who successfully use maximum-a-posteriori unigram language models to perform unsupervised morphological segmentation of English and Finnish.

\subsection{Vocabulary Allocation}

By surfacing subword units that align with morphology, the unigram LM tokenization provides the opportunity for the model to learn composable subword embeddings.
If an affix reliably signals a linguistic feature, rather than needing to store that information redundantly across the embeddings of many tokens containing the affix, the model can store it in just the embedding of the affix.

\begin{table*}[!t]
\small
    \centering
    \begin{tabular}{l |c c c c c c| c c} \toprule
        & \multicolumn{6}{|c|}{\textbf{English}} & \multicolumn{2}{c}{\textbf{Japanese}}\\
        \multirow{2}{*}{\textbf{Model}} & \multicolumn{2}{|c}{\textbf{SQuAD 1.1} (dev.)} & \multicolumn{2}{c}{\textbf{MNLI} (dev.)} & \multicolumn{2}{c|}{\textbf{CoNLL NER}} &
        \multicolumn{2}{c}{\textbf{TyDi QA} (dev.)} \\
        & EM & F1 & Acc. (m) & Acc. (mm) & Dev. F1 & Test F1 & EM & F1 \\
        \midrule
        Ours, BPE & $80.6\pm.2$ & $88.2\pm.1$ & $81.4\pm.3$ & $82.4\pm.3$ & $94.0\pm.1$ & $90.2\pm.0$ & $41.4\pm0.6$ & $42.1\pm0.6$ \\
        Ours, Uni. LM & $81.8\pm.2$ & $89.3\pm.1$ & $82.8\pm.2$ & $82.9\pm.2$ & $94.3\pm.1$ & $90.4\pm.1$ & $53.7\pm1.3$ & $54.4\pm1.2$ \\
        \midrule
        BERT$_\textsc{base}$ & 80.5 & 88.5 & 84.6 & 83.4 & 96.4 & 92.4 & -- & -- \\
        \bottomrule
    \end{tabular}
    \caption{Fine-tuning results. Metrics are averaged across 5 fine-tuning seeds with standard deviations indicated by $\pm$; due to computational constraints we did not pretrain more than once per tokenization. We include fine-tuning results for a transformer with a comparable architecture, BERT$_\textsc{base}$, for reference, although we note that a direct comparison cannot be made due to BERT$_\textsc{base}$ using both a larger pretraining corpus and a larger subword vocabulary.}
    \label{tab:fine-tune}
\end{table*}

These results suggest that the unigram LM method may allocate its vocabulary more economically. We note in Figure \ref{fig:token_freqs} that both vocabularies contain a ``dead zone'' of tokens whose frequency is much lower than the rest of the vocabulary. This is largely the result of the presence of a number of very uncommon characters, including Chinese and Japanese kanji, in the training corpus. In the BPE tokenization, however, this effect is exacerbated, with the dead zone containing about 1500 more entries as a result of the tendency of its vocabulary construction process to produce intermediate ``junk'' tokens. For example, in the case where three tokens almost always occur as a group, in order to merge them into a single token, BPE must first merge one pair before incorporating the third token; this leaves an intermediate token in the vocabulary that will only occur rarely on its own. Additionally, tokens that appear in many contexts, such as inflectional affixes (-s, -ed), will tend to merge with many adjacent units due to their frequency. However, these merges lead to embedding redundancy, as these affixes usually have the same linguistic function in every context. Since the unigram LM method selects tokens during vocabulary construction using a global optimization procedure, it does not produce junk tokens; this property also allows it to avoid merging frequent tokens with their neighbors too aggressively.

Japanese vocabulary comparisons are included in Appendix B.

\section{Downstream Task Experiments}

In order to make a fair experimental comparison between these two methods on downstream tasks, we do not use an existing pretrained language model like BERT, but instead train our own language models from scratch, controlling for the data, training objective, and optimization procedure.
We pretrain four transformer masked language models using the architecture and training objective of \textsc{RoBERTa-base} \citep{liu2019roberta} using the reference \texttt{fairseq} implementation \citep{ott-etal-2019-fairseq}. Two are pretrained on the text of English Wikipedia, comprising $\sim$3B tokens under either tokenization. The other two are pretrained on the text of Japanese Wikipedia, comprising $\sim$0.6B tokens.
In each pair, one model is pretrained on the BPE tokenization of the corpus, and the other on the unigram LM tokenization, each with a vocabulary of 20,000 tokens. Hyperparameters are listed in Appendix A.

We subsequently fine-tune each of the pretrained English models on the SQuAD question-answering task \citep{rajpurkar-etal-2016-squad}, the MNLI textual entailment task \citep{williams-etal-2018-broad}, and the English portion of the CoNLL 2003 named-entity recognition shared task \citep{tjong-kim-sang-de-meulder-2003-introduction}. We fine-tune the Japanese models on the Japanese minimal-answer subset of the TyDi question-answering task \citep{clark2020tydi}. We base our fine-tuning implementations on those of the \texttt{transformers} toolkit \citep{wolf2019transformers}.

The results of our fine-tuning experiments are presented in Table \ref{tab:fine-tune}. We show that fine-tuning models pretrained with unigram LM tokenization produces better performance than fine-tuning models pretrained with BPE tokenization for all tasks. These results suggest that the higher morphological plausibility of the unigram LM tokenization may translate into better downstream task performance as well. Larger performance gaps are evident on SQuAD and MNLI, but the largest gap appears on Japanese TyDi. Differences in pretraining may be more evident in this setting due to the fact that the Japanese portion of the TyDi training split only contains $\sim$5k examples, compared to the $\sim$88k examples available for fine-tuning on SQuAD. Additionally, written Japanese does not feature whitespace between words, so it is possible for tokenizations to differ in word boundary placement as well as subword segmentation.

\section{Conclusion}

In this work we show that the choice of input encoding makes a difference in how well pretrained language models are able to perform end tasks. This indicates that tokenization encodes a surprising amount of inductive bias, and we suggest that unigram LM tokenization may be the better choice for development of future pretrained models.

\section*{Acknowledgments}

This work was partially supported by NSF Grant IIS-1814522 and a gift from Arm. This material is also based on research that is supported by the Air Force Research Laboratory (AFRL), DARPA, for the KAIROS program under agreement number FA8750-19-2-1003. The U.S. Government is authorized to reproduce and distribute reprints for Governmental purposes notwithstanding any copyright notation thereon. The views and conclusions contained herein are those of the authors and should not be interpreted as necessarily representing the official policies or endorsements, either expressed or implied, of the Air Force Research Laboratory (AFRL), DARPA, or the U.S. Government.

\interlinepenalty=10000


The Chrysalis Opens? Photometry from the Eta Carinae HST Treasury Project, 2002-2006

Abstract: During the past decade Eta Car has brightened markedly, possibly indicating a change of state. Here we summarize photometry gathered by the Hubble Space Telescope as part of the HST Treasury Project on this object. Our data include STIS/CCD acquisition images, ACS/HRC images in four filters, and synthetic photometry in flux-calibrated STIS spectra. The HST's spatial resolution allows us to examine the central star separate from the bright circumstellar ejecta. Its apparent brightness continued to increase briskly during 2002--06, especially after the mid-2003 spectroscopic event. If this trend continues, the central star will soon become brighter than its ejecta, quite different from the state that existed only a few years ago. One precedent may be the rapid change observed in 1938--1953. We conjecture that the star's mass-loss rate has been decreasing throughout the past century.

\section{Introduction}

Eta Carinae's photometric record is unparalleled among
well-studied objects, especially since it has been near or exceeded
the classical Eddington limit during the past two or three
centuries.  From 1700 to 1800 it gradually brightened from 4th to
2nd magnitude, and then experienced its famous Great Eruption or
``supernova impostor event'' beginning about 1837.  For twenty years
it was one of the brightest stars in the sky, rapidly fluctuating
between magnitudes 1.5 and 0.0, briefly attaining $V \approx -1.0$.
After 1858 it faded below 7th magnitude, presumably enshrouded in
the nascent Homunculus nebula.  Subsequent behavior, however,
has been more complex than one might have expected.
A mysterious secondary eruption occurred in 1887--1900; then the
apparent brightness leveled off around $m_{pg} \approx 8$ for about
40 years, followed by a rapid increase in 1938--53;  after that
it brightened at a fairly constant rate for another 40-year
interval, and most recently the rate accelerated in the 1990's.
Some, but not all, of the secular brightening can be attributed to
decreasing obscuration as the Homunculus nebula expands.  However, in
truth this is more complex than it appears.
The star's physical structure has been changing in a decidedly
non-trivial way which is, at best, only dimly understood.  For
historical and observational details see  \citet{dh97,frew05,dvauc52,
oconnell56,feinstein67,feinstein74,aavso,kdetal99a,kdetal99b,
vangenderen99, sterken99,phot1}.

Spectroscopic changes have occurred along with the brightness
variations.  The 5.5-year spectroscopic/photometric cycle
\citep{gaviola53,zanella84,whitelock94,whitelock04,damineli96,phot1}
is not apparent in data obtained before the 1940's
\citep{feast01,rmh05}.  Brief ``spectroscopic events''
marking the cycle are most likely mass-ejection or
wind-disturbance episodes, probably regulated by a
companion star \citep{zanella84,kd99,smith03,heii}.
At visual wavelengths, the associated ephemeral brightness
changes represent mainly emission lines in the stellar wind,
while the longer-term secular brightening trend involves
the continuum \citep{phot1,martinconf}.  \citet{rmh05},
\citet{halpha05}, and \citet{kd05} have speculated
that the four obvious disruptions in the photometric record --
c.\ 1843, 1893, 1948, and 2000 -- might indicate a quasi-periodicity
of the order of 50 years.\footnote{
So far as we know, this idea was first voiced by Humphreys at two
meetings in 2002, but it did not appear in the published proceedings}
In any case the star has not
yet recovered from its Great Eruption seen 160 years ago.

The Hubble Space Telescope (HST) Treasury Program for $\eta$ Car was
planned specifically to study the 2003.5 spectroscopic event.  We
employed the Space Telescope Imaging Spectrograph (STIS)
and Advanced Camera for Surveys (ACS), following earlier STIS
observations that began in 1998 \citep{etatp04}.   Fortuitously, the
STIS data almost coincide with a rapid secular brightening which
began shortly before 1998 (see Section 4 below).  Those and the ACS
images are of unique photometric value for at least two reasons:
\begin{enumerate}
\item{At visual wavelengths, normal ground-based observations have
  been dominated by the surrounding Homunculus ejecta-nebula, which,
  until recently, appeared much brighter than the central star and
  which has structure at all size scales from 0.1 to 8 arcseconds.
  {\it So far, only the HST has provided well-defined measurements
  of just the central star.\/}\footnote{
    At least this is true for visual and UV wavelengths.  The
  near-infrared photometry reported by \citet{whitelock94} and
  \citet{whitelock04} may be strongly dominated by the central star.
  Those observations probably represent free-free emission in the wind
  at larger radii than the visual wavelength data.  They show both the
  spectroscopic events and the brightening trend better than other
  ground-based measurements.}
  The Homunculus is primarily a reflection
  nebula, but the Homunculus/star brightness ratio has changed
  substantially. During 1998-99, for instance, the star nearly tripled
  in apparent brightness while ground-based observations showed only
  about a 0.3-magnitude brightening of Homunculus plus star
  \citep{kdetal99b}.  This rather mysterious development is known
  from HST/STIS and HST/ACS data. }

\item{Numerous strong emission lines perturb the results for standard
  photometric systems.  H$\alpha$ and H$\beta$ emission, for example,
  have equivalent widths of about 800 and 180 \mbox{\AA} respectively
  in spectra of $\eta$ Car.  Broad-band $U$, $B$, $R$, and $I$ magnitudes,
  and most medium-band systems as well, are therefore poorly
  defined for this object.  Photometry around 5500 \mbox{\AA}, e.g.
  broad-band $V$, is relatively free of strong emission lines, but
  transformations from instrumental magnitudes to a standard system
  require the other filters \citep{kdetal99b,sterken01,vangenderen03}.
  This difficulty is somewhat lessened for HST observations restricted
  to the central star, whose spectrum has fewer emission lines
  than the bright ejecta;  and some of the HST/ACS filters are
  fairly well-adapted to the case.  At any rate the STIS and ACS
  data appear to be stable and internally consistent.  Detector and
  filter systems used in most ground-based work, on the other hand,
  require fluctuating instrumental and atmospheric corrections, and
  do not give any major advantage for this object. }
\end{enumerate}
In this paper we present the complete set of photometric data gathered
for the $\eta$ Car HST Treasury Project.  The central star has brightened,
especially in the UV, since the HST results described by \citet{phot1}.
We report three types of later measurements:
\begin{enumerate}
  \item{The star's brightness in acquisition images made with STIS
  before that instrument's failure in early 2004.  These images represent
  a broad, non-standard wavelength range from 6500 to 9000 {\AA}.}
  \item{The star's brightness in ACS/HRC images made in four filters
  (F220W, F250W, F330W, \& F550M) from October 2002 to the present.}
  \item{Synthetic photometry in flux-calibrated STIS spectra.}
\end{enumerate}

After presenting  the data below, we briefly discuss the observed
trends and what they bode for the near future of $\eta$ Car.  Our
principal reason for reporting these data now is that the Treasury
Program observations have been completed;  future HST/ACS observations
are possible but not assured.  These last Treasury Program
observations are essential for demonstrating the secular trend in
brightness (see Section \ref{trend}), that these brightness changes
suggest a fundamental change in the state of the star (see Section
\ref{discussion}) and what the near future may hold for $\eta$ Carinae
(\ref{predictions}).

\section{Data}

\subsection{STIS Acquisition Images}

Each set of STIS observations included a pair of acquisition images,
which are 100 x 100 pixel sub-frames ($5{\arcsec} \times 5{\arcsec}$)
centered on the middle row and column of the CCD
\citep{clampin96,downes97,kimquijano03}.  The STIS acquisition images
were taken with a neutral density filter (F25ND3) which, combined with
the CCD response, covered the wavelength range 2000--11000 {\AA}.
Since the star's apparent color is moderately red, these images were
dominated by fluxes at wavelengths 6500--9000 {\AA}.  Fig.
\ref{filterfig} shows that although most of the measured flux comes
from the continuum, several prominent emission features including
H$\alpha$ contributed to the measured brightness.   We measure the star's
brightness with in radius $R$ in the following manner:  If $f(x,y)$
denotes the flux level in an image where the star was centered at $x_0$,
$y_0$, we integrate the product of $w(x-x_0,y-y_0) f(x,y)$, where $w$
is a radially symmetric weighting function of the form $(1-r^2/R^2)$,$r<R$.
In effect $w$ is a ``parabolic virtual field aperture.'' For the STIS
acquisition images we chose $R = 0.3{\arcsec}$ (6 pixels).  A detailed
discussion of these reduction procedures, including a non-standard bias
level correction which we applied, is given in \citet{phot1}.

Initially we expected to add a few more points of acquisition
photometry after 2004.5, but the failure of the STIS in August 2004
curtailed our observing plans.  Thus we have only two additional
STIS data points to report (Table \ref{acqdata}) beyond those
given in \citet{phot1}.  They are useful, however, concerning
the end of the post-event recovery (see Sections \ref{trend} and
\ref{discussion} below).

\subsection{HST ACS}
HST ACS/HRC observations of $\eta$ Car were obtained for the Treasury
Project beginning in October 2002.  We have also examined publicly
available data from HST proposal 9721\footnote{``The Kinematics and
  Dynamics of the Material Surrounding Eta Carinae,'' B. Dorland,
  principal investigator} and HST proposal 10844\footnote{``Following
  Eta Carinae's Change of State,'' K. Davidson, principal investigator}.
The bias-corrected, dark-subtracted, and flat-fielded data were obtained
from the Space Telescope Science Institute via the Multi-Mission Archive
(MAST) \citep{acscal}.\footnote{\tt http://archive.stsci.edu}

Treasury Program ACS/HRC images were taken in four filters that cover
near-UV to visual wavelengths (Fig. \ref{filterfig}):
\begin{itemize}
\item{HRC/F220W and HRC/250W:  These near-UV filters sample the
  ``\ion{Fe}{2} forest'' \citep{cassatella79,altamore86,viotti89},
  whose opacity increases dramatically during a spectroscopic
  event \citep{kdetal99c,ironcurtain}.}
\item{HRC/F330W:  This filter includes the Balmer continuum
  in emission, supplemented by various emission lines.
  It also attained the best spatial resolution
  among the observations reported here.}
\item{HRC/F550M:  With a medium-width (not broad) bandpass, this
  filter samples the visual-wavelength continuum flux with only
  minor contamination by emission features.}
\end{itemize}

The brightness of the central star was measured using the same
0.3$\arcsec$ ($\sim$ 10 ACS/HRC pixels) weighted virtual aperture
used for the STIS acquisition images.  CCD flux values were converted
to the STMAG system \citep{stmag} using the keywords provided in the
MAST archive's FITS headers.  An aperture correction \`{a} la
\citet{acscal}, calculated from observations of the white
dwarf GD~71 in each of the filters (Table \ref{acscaltab}), was
applied to the measurements (Table \ref{acsdata}).  ACS fluxes
and magnitudes measured prior to MJD 52958 (2003.87) can be found
in our first paper \citep{phot1}.  {\it Caveat:\/} We did not apply
the aperture corrections to the magnitudes in that paper, but we
have done so in the plots shown here.

The F220W and F250W filters have known red leaks \citep{acshandbook}
that can affect photometry of red sources.  We
convolved extracted STIS spectra (see Sec. \ref{stisphot}) with the
response function for those filters and the ACS/HRC.  In the case of
the central star of $\eta$ Car, the flux redward of 4000{\AA} in the
F220W and F250W filters contributed only about 0.25\% and 0.06\%
respectively, insignificant compared to other sources of error.

\subsection{STIS Synthetic Photometry\label{stisphot}}

Originally the ACS/HRC images were meant to supplement the STIS
spectra.  After the untimely demise of the STIS, however, the ACS/HRC
became the most suitable mode for observing $\eta$ Car with HST.
This presented a problem of continuous monitoring in the same band
passes over the entire program, since there were no ACS/HRC images
prior to 2002.78 while the STIS data ended at 2004.18.

ACS photometry can be synthesized from the flux calibrated STIS
data, since nearly every grating tilt was observed during each STIS
visit (Table \ref{stisspectra}).  The spectra were extracted with a
weighted parabolic cross dispersion profile similar to the virtual
aperture used to measure the ACS/HRC images, convolved with the
published filter functions (Fig \ref{filterfig}), and integrated.  Because
STMAG is computed from flux density, the integrated fluxes were
divided by the effective band passes of each filter
(see Table \ref{acscaltab}).

The effective aperture for the extracted STIS spectral data is not a
rotated parabola but a parabolic cylinder having the width of the slit
(0.1\arcsec).  To correct for the difference in aperture as well as
the difference in instrumental PSF, slit throughput, and the extraction
height, we converted the STIS spectral fluxes to the ACS/HRC flux scale
using suitable correction factors (Table \ref{acscaltab}).  Those
factors were computed by comparing the results from ACS/HRC images
and photometry synthesized from STIS data obtained at time MJD 52683.
The resulting synthetic ACS/HRC photometry is given in Table \ref{fakeacs}.

Plots of these various data will be discussed in Sections \ref{trend}
and \ref{discussion} below.

\section{Distribution of Surface Brightness in the Homunculus}

Since HST and ground-based photometry have shown different rates
of change for different-sized areas, it is useful to view the
spatial distribution of the brightness.  For this purpose we have
used three ACS images made with filter F550M at $t =$ 2004.93,
2005.53, and 2005.85.   Together these give a reasonably valid
picture of the average visual-wavelength appearance during 2005.

Fig. \ref{brt-distr-1} shows the fraction of apparent brightness
within projected radius $R$ measured from the central star.  The
solid curve represents the HST data, while a companion dashed curve
incorporates Gaussian blurring with FWHM = 0.8{\arcsec},
simulating ground-based photometry with fairly good atmospheric
conditions.  Half the total light originates within
$R \lesssim 0.5{\arcsec}$ -- which is very different from
$\eta$ Car's appearance a few decades ago \citep{gaviola50,adt53,
gn72,kdmtr75,vgt84}.  Fig.\ \ref{brt-distr-1} also shows a curve
based on photographs that Gaviola obtained in 1944 \citep{gaviola50,
kdmtr75}, with a magnified spatial scale to compensate
for subsequent expansion;  even allowing for
mediocre ``seeing'' and other uncertainties, the degree of central
condensation was obviously less then. Before 1980 the central star
accounted for less than 10\% of the total apparent brightness;
now its fraction has grown to about 40\% and continues to increase.

Fig. \ref{brt-distr-2} is a map of the surface brightness, based
on the HST/ACS F550M data mentioned above.  In order to produce
simple well-defined isophotes, we have Gaussian-blurred
the image using FWHM 0.5{\arcsec}.  Apart from the
central star and nearby compact ejecta, most of the light
comes from a comma- or crescent-shaped region about
5{\arcsec} across, marked by the 80\% isophote in the
figure.  Presumably the high intensity in this area results
from strong forward scattering by dust grains in that part
of the southeast Homunculus lobe.  Surface brightnesses
in the outer lobe regions, on the other hand, are fainter
than the 50\% contour by factors typically between 100 and
200.   About half of the projected area of the Homunculus
provides only 5\% of the total visual-wavelength brightness.

\section{The Eight-year Trend\label{trend}}

Fig.\ \ref{plot1} shows the main HST photometric data on the central
star;  the most significant result is a secular brightening trend
superimposed  on the  5.5-year pattern of spectroscopic events.  The
latest observations are essential in this regard,  because the data
reported earlier by \citet{phot1} ended before the star had emerged
from the 2003.5 event and we could not be sure of the long term trend.
From 1999 to 2006 the average trend was about 0.15 magnitude per year
at visual  wavelengths and 0.19 mag yr$^{-1}$ at 2200 {\AA} -- much
faster than the rate of $\sim$ 0.025 mag yr$^{-1}$ recorded for the
Homunculus plus star from 1955 to 1995 \citep{kdetal99b,martinconf}.

The Weigelt condensations northwest of the central star
\citet{speckle86} have {\it not\/} brightened rapidly.  Located
in the equatorial plane only about 800 AU from the star\footnote{
For conversions between apparent and linear size scales we assume that
$\eta$ Car's distance is 2300 pc \citep{dh97}.
}, their light
is intrinsic emission with some reflection \citep{kdfos95}.
Fig.\ \ref{knotd} shows the brightness of ``Weigelt D,'' measured in
the same way as the star but centering the virtual aperture at offset
location $r = 0.25{\arcsec}$, position angle 336$^{\circ}$.
The absence of a strong secular trend is
significant in the following way.  Extrapolating the recent trend of
the star/ejecta brightness ratio back to the mid-1980's, one would
expect that the star should have been fainter than each
of the Weigelt blobs at that time.  But this is contradicted
by early speckle observations \citep{speckle86,speckle88};
{\it therefore the star cannot have brightened at the present-day rate
through the entire 20-year interval.\/} Moreover, the earliest HST/FOS
spectroscopy in 1991 \citep{fos95} and the ultraviolet spectra of the
star plus inner ejecta obtained with the International Ultraviolet
Explorer (IUE) from 1979 to 1990 show absolute fluxes which, though
uncertain, appear comparable to both the speckle observations and  the
1998 STIS results.  These facts imply that the central star's brightening
rate was relatively modest from 1980 until sometime in the 1990's.  We
suspect that the present-day rate began in 1994--97, when
ground-based  photometry showed unusual behavior (see, e.g., Fig.\ 2
in \citet{kdetal99b}).

The last F330W and F550M observations in Fig. \ref{plot1} confirm
the sudden 0.2 magnitude increase observed at La Plata in late 2005
\citep{laplata}.

\section{Discussion\label{discussion}}

The observed brightening of $\eta$ Car is not easy to explain.
It cannot signify a major increase in the star's luminosity,
because that would exceed the Eddington limit, producing a giant
eruption.  It cannot be a standard LBV-like eruption;  in that case
the energy distribution should have shifted to longer wavelengths, the
Balmer emission lines should have decreased, and the spectrum should
have begun to resemble an A- or F-type supergiant \citep{lbv94}.
In fact, qualitatively the star's spectrum has changed little in the
past decade, and it has become bluer, not redder.\footnote{ The
  change in color is modest, however, too small to confidently
  quote here.  Dust near $\eta$ Car has long been known to have an
  abnormally small reddening/extinction ratio, see \citet{dh97},
  \citet{fos95}, and refs.\ cited therein.}

The most obvious remaining explanation involves a change in the
circumstellar extinction,  which, in turn, probably requires a
subtle change in the stellar wind.  Mere ``clearing of the dust''
-- i.e., motion of a localized concentration of dusty ejecta -- cannot
occur fast enough \citep{kdetal99b}.  Therefore one must consider
either destruction of dust grains, or a decrease in the formation of
new dust, or both; and, if these account for the observations, why
should they happen now?

\subsection{Dust Near the Star}

The hypothetical decreasing extinction probably occurs within 2000 AU
($\sim$ 1{\arcsec}) of the star, and preferably closer, because:
\begin{enumerate}
\item{In various observations between 1980 and 1995, the star
 did not appear as bright as expected relative to the Weigelt
 blobs;  the discrepancy was a factor of the order of 10, based
 on simple theoretical arguments \citep{dh86,fos95}.  Evidently,
 then, our line of sight to the star had substantially larger
 extinction at visual wavelengths, even though its projected
 separation from the blobs was less than 0.3{\arcsec}.  The required
 extra extinction was of the order of 3 magnitudes.  Since then
 the star has brightened far more than the Weigelt objects have;
 therefore, if this involves localized extinction, its size
 scale must be a fraction of an arcsec, only a few hundred AU. }
\item{No known process seems likely to destroy dust more than
 2000 AU from the star in a timescale of only a few years.}
\item{Ground-based photometry and HST images have shown only a
 modest, fraction-of-a-magnitude increase in the brightness of
 the large-scale Homunculus lobes during the past decade
 \citep{laplata,phot1}. }
\end{enumerate}

Dust grains should condense in $\eta$ Car's wind at a distance of
200--600 AU, 2 to 10 years after the material has been ejected.\footnote{
Here, lacking a specific dust-formation model for the unusual case of
$\eta$ Car, we suppose that appreciable grain condensation begins in the
outward flowing material at the location where the equilibrium grain
temperature is around 1000 K.  This is a fairly conventional assumption
and the precise choice of temperature has little effect on our reasoning.
The quoted time-after-ejection assumes typical ejecta speeds of
200--700 km s$^{-1}$.}  Since
newly-formed dust moves outward in a timescale of several years, the
circumstellar extinction seen at any time depends partly on the
current dust formation rate.  This, in turn, depends on local wind
density, radiation density, etc., and newly formed hot grains ($T_d >
800$ K) are susceptible to destruction.  The dust column density can
thus be sensitive to small changes in the stellar parameters.
Moreover, the wind is latitude-dependent and our line of sight is
close to the critical latitude where wind parameters can vary rapidly
\citep{smith03}.  All these factors appear suitable for the proposed
explanation.

On the other hand, near-infrared observations imply that extinction
within $r < 2000$ AU  has been quite small along most paths outward
from the star.  In Fig.\ 3 of \citet{cox95}, for instance, the
2--6 $\mu$m flux indicates the high end of the dust temperature
distribution.  Modeling this in a conventional way, we find
that less than 5\% of the total luminosity was absorbed and
re-emitted by inner dust with $T_d > 500$ K during the years
1973 to 1990 when those observations were made.\footnote{
The measured flux was approximately a power law
$f_{\nu} \sim {\nu}^{-3.7}$ at wavelengths around 4 ${\mu}$m.
Assuming a typical emission efficiency dependence $Q_{\nu} \sim {\nu}$,
the observed spectral slope can be explained by a grain temperature
distribution $dN/dT \sim T^{-8.7}$.  The result noted in the text is
obtained by normalizing this to match the observed flux around
4 or 5 $\mu$m and then integrating the total emitted flux at all
wavelengths due to grains above 500 K.}  Therefore,
{\it our line of sight must be abnormal in order to have a large
amount of extinction near the star.\/}  In principle one might
view this as an argument against our proposed scenario, but no
plausible alternative has been suggested to explain the apparent
faintness of the central star before 1999 and its ratio to the
Weigelt blobs \citep{speckle86,dh86,speckle88,fos95,kdetal99b},

The spatial distribution of dust is probably quite inhomogeneous
near the star.  The Homunculus lobes have a conspicuously ``granular''
appearance;  the equatorial ejecta are clumpy, including the
Weigelt knots; and stars near and above the Eddington limit
tend to produce clumpy outflows \citep{shaviv05}.  Consequently
the radiative transfer problem includes macroscopic
effects which have not yet been modeled.  If the grain albedo
is sufficient, light may escape mainly by scattering through
interstices between condensations.  In that case, high-extinction
lines of sight may be fairly common in the inner region even
though most of the light escapes along other paths, not
necessarily radial.

Incidentally, the near-infrared photometric trends reported by
\citet{whitelock94,whitelock04} are not straightforward
to interpret.  The fairly-constant 3.5 $\mu$m flux, for instance,
represents a complicated mixture of dust formation parameters
and does not necessarily indicate a constant amount of dust;
see comments by \citet{kdetal99b}.

\subsection{The Role of the Stellar Parameters \label{stellarparams}}

If the observed brightening represents a decrease in
circumstellar extinction, the likeliest reason for this
to occur is through some change in the star -- no one has yet proposed
a suitable alternative.  The most relevant stellar parameters are
the radius,  current luminosity, and surface rotation rate, which
together determine the wind's velocity, density, and
latitude structure.  All of these may still be changing
today, 160 years after the Great Eruption;  thermal and
rotational equilibrium in particular are likely to be
poor assumptions for the star's internal structure
\citep{smith03,kd05}.

As a working hypothesis to explain $\eta$ Car's photometric
and spectroscopic record in the past 100 years, let us
tentatively suppose that {\it the mass-loss rate is gradually
decreasing,\/} while the surface rotation rate may be
increasing.  Historical considerations include:
\begin{enumerate}
\item{High-excitation \ion{He}{1} emission, now observed
at most times, was consistently absent before 1920 \citep{feast01}
and probably before 1940 \citep{rmh05}.  If a hot companion
star is present as most authors suppose, then the most obvious
way to hide or suppress its helium ionization is to immerse
the entire system in an extremely dense wind -- i.e.,
the primary star's mass-loss rate must have been larger then.
This idea is far from straightforward \citep{kd99}, but
so far as we know it is the only qualitative
explanation yet proposed.  Informally, based on Zanstra-style arguments
(i.e., assessing the volume emission measure $n_{He} n_e V$ needed to
absorb all the photons above 25 eV),
we estimate that a rate of the order of 10 times the
present value, i.e. $\sim 10^{-2}$ $M_\odot$ y$^{-1}$, would
have been required early in the twentieth century in order to suppress
the helium recombination emission. }
\item{Twenty years ago the amount of fresh dust, indicated
by the near-infrared flux, appeared consistent with a
mass-loss rate somewhat above $10^{-3}$ $M_{\odot}$ yr$^{-1}$
\citep{iue86}.  This absorbed only a small fraction of the
luminosity (Section 5.1 above), but the substantially higher
mass-loss rate suspected for earlier times would have
produced enough hot inner dust to absorb a non-negligible
fraction. }
\item{The brightness observed between 1900 and 1940 is rather
mysterious.  Judging from its mass and present-day optical
thickness, around 1920 the Homunculus (then only half as
large as it is today) should have had at least 5 magnitudes of
visual-wavelength extinction;  in a simple model the object
should have been fainter than 10th magnitude instead of
$m_{pg} \approx 8$ as was observed. No doubt the inhomogeneities
mentioned earlier played a role, but no model has been calculated.
Moreover, why did the brightness remain fairly constant even
though the Homunculus expanded by about 70\% in 1900--1940?
This interesting problem has received practically no
theoretical attention.}
\item{\ion{He}{1} emission first appeared, and $\eta$ Car's
brightness suddenly increased, between 1938 and 1953 as we
mentioned in Section 1.  This might conceivably be explained
by a decrease in the wind density;  but \citet{kd05} and
\citet{halpha05} have conjectured that 1940--1950 may
have been the time when rotation became fast enough to
produce latitude structure in the wind.  If so, a
higher-excitation, lower-density zone then developed at
low latitudes \citep{smith03}. }
\end{enumerate}

The above points inspire two hypotheses that may explain
the rapid brightening trend shown in Fig.\ \ref{plot1}.
First, if the mass-loss rate has been decreasing,
this tends to reduce the column density of
recently-formed dust along our line of sight.  Meanwhile
(or alternatively), perhaps the wind's latitude structure
is continuing to evolve so that its dense zone is now moving
out of the line of sight.  HST data suggest that our line
of sight has been fairly close to the critical boundary
latitude separating the two phases \citep{smith03}.  A
small increase in surface rotation rate, or some other
parameter change, might conceivably move the dense zone
to higher latitudes, decreasing the amount of dust that
forms along our line of sight.  This idea is appealing
because it suggests a way in which the effective
extinction may be very sensitive to the stellar parameters.

This problem obviously requires detailed models far beyond
the scope of this paper, combining the star's changing
structure, its wind, dust formation, and possibly dust
destruction.

\subsection{Concerning the 5.5-year Cycle}

Figs.\ \ref{plot1} and \ref{plot2} reveal no major surprises
about the 2003.5 spectroscopic event, but several comments are
worthwhile.  First, the sharp drop in UV brightness (filters
F220W and F250W) is qualitatively understood and does not
involve circumstellar dust.  During both the 1998 and the 2003
events, STIS data showed very heavy ultraviolet blanketing by
ionized metal lines;  indeed the star became quite dark at some
wavelengths between 2000 and 3000 {\AA} \citep{ironcurtain}.
We further note that just before the spectroscopic event, a
slight increase occurred at wavelengths below 4000 {\AA}
(filters F220W, F250W, F330W), but not at visual and far-red
wavelengths (F550M and F25ND3).  Ground-based visual-wavelength
and near-IR photometry showed a qualitatively similar effect
\citep{vangenderen03,whitelock04,laplata}.  The brightening is particularly
prominent in J, H, and K which are dominated by free-free emission
\citep{whitelock04}. The ACS F550M and STIS F25ND3 data primarily
measure the continuum brightness, while the other HST filters are
heavily influenced by strong emission or absorption lines.    At
about the same time \ion{He}{1} emission in the central star also went
through a similar increase in brightness \citep{martinconf}.  The minor
pre-event brightening thus appears to represent an increase in some
emission features implying a temporary increase in ionizing flux.  The
primary star may provide additional UV photons or the hypothetical hot
companion star may excite the primary wind more than usual at that
time (just before periastron), but no quantitative model has been
attempted.

Figs.\ \ref{plot1} and \ref{plot2} contain interesting hints
about the timescale for the star's post-event recovery.  Four
months after the 2003.5 event, for instance, the 2--10 keV
X-ray flux had increased almost to a normal level \citep{xray}.
The HST/ACS F220W and F250W brightnesses, however, were still
quite low at that time, and they required about eight months
to recover.  This timescale must be explained in any valid model
for the spectroscopic events.

\citet{halpha05} noted serious differences between STIS
spectra of the 1998.0 and 2003.5 events, and interpreted them
as evidence for a rapid secular physical change in $\eta$ Car.
\citet{damineli99} had earlier found that \ion{He}{1} emission
became progressively weaker after each of the last few
spectroscopic events.  These clues are obviously pertinent
to our comments in Section \ref{stellarparams} above.

Fluctuations {\it between\/} spectroscopic events have received
little attention in the past.   For instance, Fig.\ \ref{plot1}
shows a brief 0.2-magnitude brightening at 2001.3; measured by the
STIS in both imaging and spectroscopic mode.  It was correlated
with the behavior of a strange unidentified emission line
near 6307 {\AA}, and with other subtle changes in the spectrum
\citep{uemit}.  This is interesting because mid-cycle events
have not been predicted in any of the competing scenarios
for the 5.5-year cycle.  Perhaps the effects seen in 2001
indicate the level of basic, LBV-like fluctuations in
$\eta$ Car.

\subsection{Eta Carinae in the Near Future \label{predictions}}

The appearance of $\eta$ Car and the Homunculus nebula has
changed dramatically.  Twenty years ago the entire object
could have been described as ``a bright, compact nebula having
an indistinct eighth-magnitude central core;''   but a few years
in the future, if recent trends continue, it will be seen
instead as ``a fifth- or even fourth-magnitude star accompanied
by some visible nebulosity.''  Meanwhile the color is gradually
becoming bluer.  This overall development has long been expected
\citep{kd87}, but now appears to be occurring 20 years ahead of
schedule.   If it signals an irregularity in the star's recovery
from the Great Eruption, then this may be a highly unusual clue
to the highly abnormal internal structure.  Unsteady diffusion of
either the thermal or the rotational parameters would be significant
for stellar astrophysics in general.

There are several practical implications for future observations of
this object.  Valid ground-based spectroscopy of the star (strictly
speaking its wind) is becoming feasible for the first time,
as its increased brightness overwhelms the emission-line contamination
by inner ejecta.  Unfortunately this implies that the inner ejecta
-- particularly the mysterious Weigelt knots -- are becoming difficult
to observe.  In fact, since the HST/STIS is no longer available,
they are now practically impossible to observe.  When some new
high-spatial-resolution spectrograph becomes available in the
future, the inner ejecta will probably be much fainter than the
star.

The expected future of the larger-scale Homunculus nebula is
also interesting.  At present it is essentially a reflection
nebula.  However, based on the presence of high-excitation
emission lines such as [\ion{Ne}{3}] close to the star, the
system almost certainly contains a source of hydrogen-ionizing
photons with energies above 13.6, and helium-ionizing photons
above 25 eV.  (See, e.g., \citet{zanella84};  most recent
authors assume that this source
is a hot companion star.)  Eventually, when circumstellar
extinction has decreased sufficiently due to expansion and other
effects, the UV source will begin to photoionize the
Homunculus.  This is especially true if the primary
stellar wind is weakening as we conjectured above.
First the inner ``Little Homunculus'' will become a
bright compact \ion{H}{2} region, and then the bipolar
Homunculus lobes.  The time when that will occur is not
obvious, but it may be within the next few decades if
current trends continue.

\section{Acknowledgments}
This research was conducted as part of the HST Treasury Project on
$\eta$ Carinae via grant no. GO-9973 from the Space Telescope Science
Institute.
We are grateful to T.R. Gull and Beth Perriello for
assisting with the HST observing plans.
We also especially thank
Roberta Humphreys, J.T. Olds, and Matt Gray at the University of
Minnesota for discussions and helping with non-routine steps in the
data preparation and analysis.


Heavy Elements in the Early Galaxy

Abstract: The oldest stars in the universe retain to a great extent detailed information on the chemical composition of the interstellar medium at the time of their birth. Hence the earliest phases of Galactic chemical evolution and nucleosynthesis in the early universe can be investigated by means of the old metal-poor stars. For the majority of extremely metal-poor (EMP) stars the element ratios follow a normal pattern, but 10-15% of the stars are enhanced in heavy neutron-capture (r- or s-processes) elements by large factors, and about 20% are strongly enriched in carbon. The enhancement of some elements could be the result of highly non-spherical supernova and inefficient mixing in the early interstellar medium. Alternative, they could be due to mass transfer from a former AGB or supernova binary companion that has now evolved to a white dwarf or neutron star. If the latter explanation is true we can detect these stars as long-period binaries. Radial velocity monitoring over a period of ~5 years of a sample of EMP stars with either r-process element and/or carbon enhancement is presented. The results indicate that pure r-process and carbon enhancements are not results of mass transfer from a binary companion.

\section{Introduction}
Extremely metal-poor stars should represent the composition of matter in
early galaxies. Thus, from detailed abundance analysis of such stars, we can
gain insight into the nucleosynthesis and element enrichment of the early
interstellar medium. For the majority of EMP stars the elements ratios follow
a normal pattern, but 10-15 \% of the stars are enhanced in heavy
neutron-capture (\emph{r}- or \emph{s}-process) elements by large factors, and about 20 \%
are strongly enriched in carbon \cite{2005}.
The enhancement of some elements could be the result of highly non-spherical
supernovae and inefficient mixing in the early interstellar
medium. Alternatively, they could be due to mass transfer from a former AGB or
supernova companion binary, that has now evolved to a white dwarf or a neutron
star. If the latter explanation is true, we can detect these stars as
long-period binaries.

\section{Sample and Method}
The sample contains 40 stars, 17 of which are enhanced in \emph{r}-process elements,
eight with moderate enhancement $(0.3 < [$r/Fe$] < 1.0)$ and nine with the large
overabundances $([$r/Fe$] > 1.0)$. The remaining 23 stars are carbon enhanced
stars (CEMP), of these 12 show signatures of \emph{s}-process elements in their
spectra (CEMP-\emph{s}) while 8 have no such signatures (CEMP-\emph{no}). The last three
stars show both \emph{r}- and \emph{s}-process signatures (CEMP-\emph{r/s}). The sample includes
CS22892-052 which is enhanced in both carbon and \emph{r}-process elements \cite{Sneden2003}.

Medium-resolution low S/N spectra of the stars have been obtained over a
period of five years with the FIES spectrograph at the Nordic Optical
Telescope at La Palma. Cross-correlation have been performed to monitor the
radial velocity variations of the stars over the period with a precision of
100-300m/s.
\newpage
\section{Results}
\subsection{r-process enhanced stars}
Among the 17 \emph{r}-process enhanced stars three where found to be binaries \cite{Hansen2011},
the remaining 14 show no significant variation in their radial velocity over
the five year period. Figure \ref{r-star} shows the orbit of one of the
observed binaries, HE 1044-2509 with a period of 37 days.
In all three binary systems found the stars are normal giant branch binaries
and there is no sign that the secondary has passed through the AGB stage of
evolution or exploded as a supernova, which could have poluted the surface of
the primary \cite{Mermilliod1996}.

\begin{center}
\begin{figure}[h]\centering
\includegraphics[scale=0.3]{HE1044_2509poster.eps}
\caption{Observed orbit of the \emph{r}-process enhanced star HE 1044-2509, with a period of 37 days.}
\label{r-star}
\end{figure}
\end{center}

\subsection{Carbon enhanced stars}
The preliminary results for the carbon enhanced sample show that two out of
eight CEMP-\emph{no}, nine out of twelve CEMP-\emph{s} and one of the three CEMP-\emph{r/s} stars are
in binary systems. These results are shown in figures \ref{CEMPno}-\ref{CEMPs}.
Figure \ref{CEMPno} shows the result of the radial velocity monitoring
of a CEMP-\emph{no} star. The plot clearly shows no significant variation in
radial velocities of the star over the five years of measurements. Figure \ref{CEMPrs} shows
the measured radial velocities for a CEMP-\emph{r/s} star, here there is a clear variation over the
five year period, indicating a binary with a very long period. Figure \ref{CEMPs} shows
an orbit plot of one of the binary CEMP-\emph{s} star systems.
The majority of the CEMP-\emph{s} stars are found in binary systems, but not all of these are long period
binaries. Hence in some orbits there is no room for the secondary to have
passed through the AGB phase, where the mass transfer would take place.

\begin{center}
\begin{figure}\centering
\includegraphics[scale=0.4]{CS2877_001_poster.eps}
\caption{Radial velocity measurements of the CEMP-\emph{no} star CS 22877-001
  over a period of 5 years, RMS=179.25m/s}
\label{CEMPno}
\end{figure}
\end{center}
\begin{center}
\begin{figure}\centering
\includegraphics[scale=0.4]{LP625-44_poster.eps}
\caption{Radial velocity measurements of the CEMP-\emph{r/s} star LP 625-44
  over a period of 5 years. RMS=2177.00 m/s}
\label{CEMPrs}
\end{figure}
\end{center}
\newpage
\begin{center}
\begin{figure}\centering
\includegraphics[scale=0.3]{HE0507-1430poster.eps}
\caption{Orbit of CEMP-\emph{s} star HE 0507-1430 with a period of 446 days.}
\label{CEMPs}
\end{figure}
\end{center}
\newpage

\section{Conclusions}
The CEMP-\emph{no} and \emph{r}-process enhanced subsamples are found to have a normal
frequency of binary stars, this strongly suggests that the enhancement in
carbon and \emph{r}-process elements seen in these stars are not connected with the
binary status of the stars. The carbon and \emph{r}-process elements are extrinsic to
the stars observed today and were likely injected into the interstellar medium
in a collimated manner which make these stars chemical indicators of their
formation site in the early Galaxy. The majority of the CEMP-\emph{s} stars are found
to be part of a binary system, hence the origin of the carbon and s-process
elements in these stars could be due to mass transfer from an AGB companion,
but not all of the binary systems found have long periods with room to
accommodate an AGB star.

Solar and Stellar Astrophysics (astro-ph.SR)

Heavy Elements in the Early Galaxy