Self-Supervised Learning for Segmentation

Abstract: Self-supervised learning is emerging as an effective substitute for transfer learning from large datasets. In this work, we use kidney segmentation to explore this idea. The anatomical asymmetry of kidneys is leveraged to define an effective proxy task for kidney segmentation via self-supervised learning. A siamese convolutional neural network (CNN) is used to classify a given pair of kidney sections from CT volumes as being kidneys of the same or different sides. This knowledge is then transferred for the segmentation of kidneys using another deep CNN using one branch of the siamese CNN as the encoder for the segmentation network. Evaluation results on a publicly available dataset containing computed tomography (CT) scans of the abdominal region shows that a boost in performance and fast convergence can be had relative to a network trained conventionally from scratch. This is notable given that no additional data/expensive annotations or augmentation were used in training.

\section{Introduction}
\label{sec:intro}

These guidelines include complete descriptions of the fonts, spacing, and
related information for producing your proceedings manuscripts.

\section{Formatting your paper}
\label{sec:format}

All printed material, including text, illustrations, and charts, must be kept
within a print area of 7 inches (178 mm) wide by 9 inches (229 mm) high. Do
not write or print anything outside the print area. The top margin must be 1
inch (25 mm), except for the title page, and the left margin must be 0.75 inch
(19 mm).  All {\it text} must be in a two-column format. Columns are to be 3.39
inches (86 mm) wide, with a 0.24 inch (6 mm) space between them. Text must be
fully justified.

\section{PAGE TITLE SECTION}
\label{sec:pagestyle}

The paper title (on the first page) should begin 1.38 inches (35 mm) from the
top edge of the page, centered, completely capitalized, and in Times 14-point,
boldface type.  The authors' name(s) and affiliation(s) appear below the title
in capital and lower case letters.  Papers with multiple authors and
affiliations may require two or more lines for this information.

\section{TYPE-STYLE AND FONTS}
\label{sec:typestyle}

To achieve the best rendering both in the proceedings and from the CD-ROM, we
strongly encourage you to use Times-Roman font.  In addition, this will give
the proceedings a more uniform look.  Use a font that is no smaller than nine
point type throughout the paper, including figure captions.

In nine point type font, capital letters are 2 mm high.  If you use the
smallest point size, there should be no more than 3.2 lines/cm (8 lines/inch)
vertically.  This is a minimum spacing; 2.75 lines/cm (7 lines/inch) will make
the paper much more readable.  Larger type sizes require correspondingly larger
vertical spacing.  Please do not double-space your paper.  True-Type 1 fonts
are preferred.

The first paragraph in each section should not be indented, but all the
following paragraphs within the section should be indented as these paragraphs
demonstrate.

\section{MAJOR HEADINGS}
\label{sec:majhead}

Major headings, for example, "1. Introduction", should appear in all capital
letters, bold face if possible, centered in the column, with one blank line
before, and one blank line after. Use a period (".") after the heading number,
not a colon.

\subsection{Subheadings}
\label{ssec:subhead}

Subheadings should appear in lower case (initial word capitalized) in
boldface.  They should start at the left margin on a separate line.

\subsubsection{Sub-subheadings}
\label{sssec:subsubhead}

Sub-subheadings, as in this paragraph, are discouraged. However, if you
must use them, they should appear in lower case (initial word
capitalized) and start at the left margin on a separate line, with paragraph
text beginning on the following line.  They should be in italics.

\section{PRINTING YOUR PAPER}
\label{sec:print}

Print your properly formatted text on high-quality, 8.5 x 11-inch white printer
paper. A4 paper is also acceptable, but please leave the extra 0.5 inch (12 mm)
empty at the BOTTOM of the page and follow the top and left margins as
specified.  If the last page of your paper is only partially filled, arrange
the columns so that they are evenly balanced if possible, rather than having
one long column.

In \LaTeX, to start a new column (but not a new page) and help balance the
last-page column lengths, you can use the command ``$\backslash$pagebreak'' as
demonstrated on this page (see the \LaTeX\ source below).

\section{PAGE NUMBERING}
\label{sec:page}

Please do {\bf not} paginate your paper.  Page numbers, session numbers, and
conference identification will be inserted when the paper is included in the
proceedings.

\section{ILLUSTRATIONS, GRAPHS, AND PHOTOGRAPHS}
\label{sec:illust}

Illustrations must appear within the designated margins.  They may span the two
columns.  If possible, position illustrations at the top of columns, rather
than in the middle or at the bottom.  Caption and number every illustration.
All halftone illustrations must be clear black and white prints.  If you use
color, make sure that the color figures are clear when printed on a black-only
printer.

Since there are many ways, often incompatible, of including images (e.g., with
experimental results) in a \LaTeX\ document, below is an example of how to do
this \cite{Lamp86}.

\begin{figure}[htb]

\begin{minipage}[b]{1.0\linewidth}
  \centering
  \centerline{\includegraphics[width=8.5cm]{image1}}
  \centerline{(a) Result 1}\medskip
\end{minipage}
\begin{minipage}[b]{.48\linewidth}
  \centering
  \centerline{\includegraphics[width=4.0cm]{image2}}
  \centerline{(b) Results 3}\medskip
\end{minipage}
\hfill
\begin{minipage}[b]{0.48\linewidth}
  \centering
  \centerline{\includegraphics[width=4.0cm]{image3}}
  \centerline{(c) Result 4}\medskip
\end{minipage}
\caption{Example of placing a figure with experimental results.}
\label{fig:res}
\end{figure}

\vfill
\pagebreak

\section{FOOTNOTES}
\label{sec:foot}

Use footnotes sparingly (or not at all!) and place them at the bottom of the
column on the page on which they are referenced. Use Times 9-point type,
single-spaced. To help your readers, avoid using footnotes altogether and
include necessary peripheral observations in the text (within parentheses, if
you prefer, as in this sentence).

\section{COPYRIGHT FORMS}
\label{sec:copyright}

You must include your fully completed, signed IEEE copyright release form when
you submit your paper. We {\bf must} have this form before your paper can be
published in the proceedings.  The copyright form is available as a Word file,
a PDF file, and an HTML file. You can also use the form sent with your author
kit.

\section{REFERENCES}
\label{sec:ref}

List and number all bibliographical references at the end of the paper.  The references can be numbered in alphabetic order or in order of appearance in the document.  When referring to them in the text, type the corresponding reference number in square brackets as shown at the end of this sentence \cite{C2}.

\bibliographystyle{IEEEbib}

\section{Introduction}

In nature, human beings learn cumulatively. We build upon previous knowledge to learn new concepts quickly and efficiently.
One way to achieve this in neural networks has been through transfer learning where a pre-trained (on a large dataset) network is used for training for the new task with the associated data. Generally, a neural network learns basic features such as edges and lines in the first few layers. The complexity of features learned by the network increases from the input layer to the final layer with the later ones being more task-specific. Hence, only the weights of the later layers are typically modified during transfer learning.
Ideally, the similarity level of the pre-training task and main task can yield a good transfer in performance. However, in the case of medical images where labeled data is scarce, this is difficult. Nevertheless, there have been attempts to do transfer learning across domains, for example, disease classification with the VGG network \cite{menegola2017knowledge} whereas such attempts are sparse for the segmentation task.

Self-supervised learning is another recent paradigm that can offer a solution to the data sparsity problem. Here, a model is pre-trained on a proxy task based on a dataset that is also used for the main task. This proxy task is chosen such that it is easy to solve, but requires learning some form of image semantics. It is formulated such that implicit information in the same dataset can be used as labels, thus removing the need for additional annotation.

Many examples of such tasks are found in the recent literature in computer vision. Agrawal et al.~\cite{agrawal2015learning} tasked the network to predict the camera transformation of moving targets for the main tasks of scene recognition and recognition. Doersch et al.~\cite{doersch2017multi} predicted the relative position of patches for object detection in the Pascal VOC dataset \cite{everingham2010pascal}. Recently, Vondrick et al.~\cite{vondrick2018tracking} used the colorization of videos as a proxy task for visual tracking.

Self-supervision is a promising idea in medical image analysis since medical data is often rich in anonymous metadata such as patient age, medical history, and longitudinal information but often lacking manual annotations by medical experts.
On longitudinal MR data, Jamaludin et al.~\cite{jamaludin2017self}  predicted the degradation level of vertebral disks using self-supervision after using a proxy task which classified pairs of images as belonging to the same or a different patient. Li et al.~\cite{li2018non} maximized the distance between registered images at multiple scales as a proxy task for non-rigid image registration.
However, the use of self-supervision for improving segmentation in medical volumes is relatively unexplored.

In this work, we explore self-supervision for medical image segmentation. The selection of an appropriate proxy task is critical to the effectiveness of self-supervised learning and needs careful design. We demonstrate this for kidney segmentation from abdominal CT volumes. The proposed proxy task exploits the anatomical \textit{asymmetry} between the left and right kidneys. We show that segmentation with self-supervision allows for faster convergence and a better performance relative to training from scratch while using the same amount of data.

\section{Method}
The left and right kidney differ slightly in size, shape, and spatial location~\cite{frimann1961normal} (see fig \ref{fig:kidney}). Thus, we propose a proxy task to classify whether a given pair of kidneys belong to the same side. To accomplish this, the network needs to develop an understanding of the structure and sizes of the kidneys. We hypothesize that this knowledge is useful in the main task of kidney segmentation.
We begin by dividing the abdominal CT volume into two halves along the sagittal plane, thus obtaining one kidney in each half. We observed that when complete halves of the CT scan are passed, the network learns to perform this task very easily, based on the spatial location of the two kidneys. In such cases when the task is too easy and does not require considerable semantics, it is observed that transfer learning to do a main task is poor. It is desirable to force the network to learn to do the task, based only on the shape and size, rather than the spatial location.
Accordingly, each kidney section is extracted using the kidney annotation mask and a fixed region of 64x112x112 pixels around the kidney is passed to the network.
\begin{figure}
    \centering
    \includegraphics[scale=0.35]{kidney_cropped.png}
    \caption{Axial view of right and the left kidney in a CT volume}
    \label{fig:kidney}
\end{figure}
Thus, only the kidney part of the scan is passed to the network for the proxy task.
 A siamese network, composed of two identical sub-networks with shared weights~\cite{bromley1994signature}, is employed to perform this proxy task. Each of the two branches of the network is given the region of one kidney. Label 1 (0) is assigned if both the kidneys are of the same (opposite) side. The siamese network for the proposed proxy task is shown in fig. \ref{fig:proxyArch}
 \begin{figure}
     \centering
     \includegraphics[scale=0.2]{proxy_arch_full.jpeg}
     \caption{Siamese network for proxy task}
     \label{fig:proxyArch}
 \end{figure}
The network is trained using contrastive loss, defined as
\begin{equation*}
L_C=\sum^N_{n=1} (y)d^2+ (1-y) \text{max}(0,m-d)^2
\end{equation*}
where, $y$ is the label; $d = || a - b ||^2 $ is the L2 distance between the embeddings $a$ and $b$ of the final layers of each branch of the siamese network; $m$ is the margin.
This loss works by minimizing the distance when the label is 1 but maximizing it when the label is 0. After the embeddings of opposite pairs cross $m$, the loss flips to 0. The value of margin was set to 1 in our implementation.

On completion of training for the proxy task, one of the branches of the siamese network is used as an encoder for the main kidney segmentation task. Since the siamese network uses shared weights for both branches, any of the branches can be used as the encoder. Thus, only the encoder part of the segmentation network is pre-trained. The rest of the network uses randomly initialized weights. The segmentation network is trained using a weighted sum of soft dice loss~\cite{milletari2016v} and weighted binary cross-entropy (BCE). The weights for BCE and dice loss are initialized as 0.6 and 0.4 respectively. As training progresses, the weight for BCE is decreased while the weight for dice loss is increased by the same amount. The intuition behind this is that BCE improves voxelwise performance while dice loss improves segmentation overlap.

\section{Experiments and results}

\subsection{Implementation details}
We employ an encoder-decoder system with U-Net like skip connections for the segmentation. The encoder branch consists of 4  blocks with densely connected layers. It has been shown that densely connected layers control the vanishing gradient problem while keeping the number of parameters low~\cite{huang2017densely}. Each of these blocks consists of 2, 2, 4 and 8 densely connected layers respectively. After each block, downsampling is performed with the help of a 3D convolutional layer with stride 2. This is followed by another convolutional layer with kernel size 1x1x1 to combine and reduce the number of feature maps.

To reduce complexity, the decoder is smaller and consists of plain 3D convolutional blocks connected serially. Each block in the decoder comprises of 2 3D convolutional layers of kernel size 3x3x3. After each block, upsampling is performed using a transpose convolutional layer.
We also connect an additional reconstruction section to the encoder to form an autoencoder. This reconstruction part is structurally similar to the decoder except for the last layer but does not employ any skip connections. This block serves as a regularizer during training and controls overfitting~\cite{sabour2017dynamic}. Fig.~\ref{fig:DUN} shows the network architecture.

As 3D convolution is memory intensive, we have trained with batch size 1. Group norm is better suited for regularization in the case of small batch sizes~\cite{groupNorm}. Hence, all convolutional layers are preceded by a Group norm layer. We use Adam optimizer with an initial learning rate $10^{-3}$ and weight decay $10^{-2}$. The code is implemented with the PyTorch framework in Python and was run on NVIDIA GTX 1080GPU with 11GB RAM.
\begin{figure}[h!]
    \centering
    \includegraphics[scale=0.35,trim={1.2cm 0 0 0}]{DUN_arch_final.png}
    \caption{Network architecture for segmentation}
    \label{fig:DUN}
\end{figure}

\subsection{Dataset}
The CT dataset from the KiTS 2019 challenge~\cite{kitsData} was used for assessment. It consists of abdominal CT scans of 210 cases with manual annotations and 90 cases without annotation. The data was first resampled to have a uniform voxel spacing of 3.22x1.62x1.62 mm, resulting in a median size of 128x248x248 voxels. The voxels were clipped to a window of [-80,300] by a windowing operation to improve the contrast of the kidney region. Data normalization was done by subtracting the mean and dividing by the standard deviation. Rather than resizing the volumes to a fixed size, the volumes were zero-padded to obtain a size closest to the nearest multiple of 16 to permit some variable size input to the network.

\subsection{Experiments and results}
\begin{figure}[h!]
    \includegraphics[scale=0.4]{qualititative_overlays.png}
    \caption{\label{fig:segImage} Sample segmentation results at the end of 200 epochs for 3 cases. Top to bottom: cases 1-3. Left to Right: results of models trained without (i.e. trained from scratch) and with self-supervision, overlaid on the ground truth. Green: Ground truth; Red: Prediction.}

\end{figure}
The 210 volumes were split randomly into 2 sets: 80\% for training while reserving the remaining 20\% for validation. Two identical networks were taken and one was trained using self-supervision and the resulting model is henceforth referred to as a model with self-supervision or MwS. The second network was trained from scratch and results in a model referred to as a model without self-supervision or MwoS. The initial training settings for both networks were identical and training was done for a fixed number of epochs. The effectiveness of self-supervised learning was evaluated both qualitatively and quantitatively.

\begin{figure}
    \centering
    \includegraphics[scale=0.3]{comparison_dice.png}
    \caption{Progression of DC over epochs on the validation set}
    \label{fig:diceCurve}
\end{figure}

For the quantitative comparison, the mean Dice score coefficient (DC) was chosen. This score is defined as
\begin{equation*}
    DC = \frac{2TP}{2TP+FP+FN}
\end{equation*}
where TP, FP and FN are the number of true positives, false positives and false negatives respectively.

\begin{table}
\centering
\caption{\label{tab:res}Comparison of quantitative results}

\begin{tabular}{|c|c|c|c|c|c|c|}
\cline{1-7}
\multicolumn{1}{|c|}{\multirow{2}{*}{}} & \multicolumn{2}{c|}{DC} & \multicolumn{2}{c|}{HD} & \multicolumn{2}{c|}{BL (\%)}\tabularnewline
\cline{2-7}
 & MwoS & MwS & MwoS & MwS & MwoS & MwS\tabularnewline
\hline
\hline
Val. & 0.907 & 0.931 & 0.303 & 0.291 & 14.0 & 12.9\tabularnewline
Test & 0.853 & 0.880 & - & - & - & -\tabularnewline
\hline
\end{tabular}

\end{table}
For further validation, we also compared two additional metrics -  Hausdorff distance (HD) and the difference in boundary length of prediction and ground truth (BL).
The obtained values (for both MwoS and MwS) for these are presented for the validation, and test sets in table \ref{tab:res}.
After training for 200 epochs, a peak DC of 0.931 and 0.907 were achieved with MwS and MwoS, respectively, on the validation set.
Ideally, higher values (close to 1) are good for DC and lower values are good for HD and BL.
It is evident from table \ref{tab:res} that MwS performs better than MwoS as per all 3 metrics.
The test set of 90 volumes is released by challenge organizers without annotations. Evaluation results (only DC) on this set can be obtained by submitting prediction masks on the challenge website. The DC value drops by roughly the same amount.
The first ranked performance on the KiTS challenge leaderboard achieves 0.974 DC for kidney segmentation by employing 6-fold data augmentation and training for 1000 epochs~\cite{isensee2019attempt}. In comparison, we have achieved the reported result without any data augmentation and by training for $\frac{1}{5}^{th}$ number of epochs. This further reinforces the fast convergence of our proposed method.

Fig.~\ref{fig:diceCurve} shows the progression of DC values over epochs for the MwS and MwoS for the validation set. For clarity of visualization, the plots are shown after a moving average operation. Relative to MwoS, MwS can be seen to yield higher DC values even in the first few epochs and converge much faster, with a higher DC value at the end of the 200 epochs.

Fig.~\ref{fig:segImage} shows the segmentation results of MwS, overlaid on the volume and ground truth. The segmentation results of MwoS overlaid on the volume, are compared on the right side. It can be seen that with MwS, the segmentation captures the fine structures as well without over-segmenting. In the case of MwoS, voxels towards the edges of the kidneys are seen to be misclassified as background while in some locations some over-segmentation can be observed.

\section{Conclusion}
We demonstrated the application of self-supervised learning for segmentation in medical imaging. A novel proxy task was used to perform self-supervised learning for segmentation. Self-supervision for segmentation is promising as it leads to faster convergence and a boost in results without using any additional data or data augmentation.
In the future, generalized criteria for the selection of a good proxy task may be formulated. The success of self-supervised learning in a more generic manner would lead towards reducing the need for large datasets for transfer learning.
\bibliographystyle{IEEEbib}

Computer Vision and Pattern Recognition (cs.CV)


Star Formation Histories of Nearby Galaxies and the Connection to High Redshift

Abstract: It is an obvious statement that all the galaxies we see today in and around our Local Group have been forming and evolving for a significant fraction of the age of the Universe. It is not a great leap of logic to further state that the manner in which they have formed and evolved must be fairly representative of these processes in general. Unless of course we would like to assume that our local region of space is in some way peculiar for which there is no evidence. In other words, if we are able to determine accurate star formation histories for the nearby galaxies back to the ages of the oldest globular clusters then we will also obtain a representative picture of how galaxies have evolved from the earliest times, and predict what nearby galaxies looked like at intermediate and high redshifts.Deep, precision, multi-colour photometry of resolved stellar populations in external galaxies can uniquely determine the star formation histories of nearby galaxies going back many Gyrs. Hubble Space Telescope and high quality ground based imaging have recently resulted in dramatic Colour-Magnitude Diagrams of the faint old resolved stellar populations in nearby galaxies. Although data deep enough to unambiguously trace back to the very oldest populations does not yet exist (except for a few small dSphs in the Galaxy Halo), these preliminary studies make the potential for deeper data for a range of galaxy types look very exciting. For example, recent results on the very low metallicity dwarf irregular galaxy Leo A suggests we have found a predominantly, if not entirely, young galaxy, less than 2 Gyr old, in the Local Group. Nearby faint star Colour-Magnitude Diagrams thus provide an important and independent method to confirm the high redshift galaxy survey predictions of galactic evolution.

\section{Colour-Magnitude Diagram Analysis}

Stellar evolution theory provides a number of clear predictions, based on
relatively well understood physics, of features expected in
Colour-Magnitude Diagrams (CMD) for different age and metallicity stellar
populations (see Figure~1).  There are a number of clear indicators of
varying star formation rates ({\it sfr}) at different times which can be
combined to obtain a very accurate picture of the entire star formation
history (SFH) of a galaxy.

\subsection{Main Sequence Turnoffs (MSTOs)}

If we can obtain deep enough exposures of the resolved stellar populations
in nearby galaxies we can obtain the {\it unambiguous age information that
comes from the luminosity of MSTOs}.  Along the Main Sequence (MS) itself
different age populations overlie each other completely making the
interpretation of the MS luminosity function complex, especially for older
populations.  However the MSTOs do not overlap each other like this and
hence provide the most direct, accurate information about the SFH of a
galaxy.  MSTOs can clearly distinguish between bursting star formation and
quiescent star formation, {\it e.g.}  \cite{hk98}.  The age resolution that is
possible does vary, becoming coarser going back in time.  Our ability to
disentangle the variations in {\it sfr} depends upon the the intensity of
the past variations and how long ago they occured and which filters are
used for observation.  For ages less than about 1.5~Gyr it is possible to
have detailed resolution on the 10$-$100~Myr time scales.  As can be seen in
Figure~1, the ages begin to crowd together for older populations.  Beyond
about 8~Gyr ago the age resolution with optimum data is on the scale of
roughly a Gyr.  This of course means that a very short high intensity burst
of star formation in this period will be ``spread out '' over a Gyr time
period and so seem less intense and longer lasting.  As will be described
in the following sections, however, there are other indicators in a CMD
which help to narrow down the range of possible SFHs.

\hskip -1.5cm
\psfig{figure=moriond_fig1.ps,height=10cm,width=10cm}
\vskip -7.1cm
\hskip 7.cm
\begin{picture}(100,30)(0,0)
\put(0,0){\parbox{8.5cm}{\small Figure~1: Isochrones for a single
metallicity (Z=0.001) and a range of ages, as marked in Gyr
\cite{b94}, at the MSTOs.  Isochrones were designed for single age
globular cluster populations and are best avoided in the
interpretation of composite populations, which can best be modeled
using Monte-Carlo techniques ({\it e.g.} \cite{et96}).
}}
\end{picture}
\vskip4.cm

\subsection{The Core-Helium Burning Blue Loop Stars (BLs)}

Stars of certain metallicity and mass go on, what are elegantly refered to
as, ``Blue Loop Excursions'' after they ignite He in their core.  Stars in
the BL phase are several magnitudes brighter than when on the MS.  They
thus provide a more luminous opportunity to accurately determine the age
and metallicity of the young stellar population (in the range,
$\lsim$~1~Gyr old) in nearby low metallicity galaxies
\cite{dp, dp1, dp2}.  The shape and mass at which these ``loops'' are
seen in a CMD are a strong function of metallicity and age, and the
luminosity of a BL star is fixed for a given age. Subsequent
generations of BL stars do not overlie each other as they do on the
MS.  The lower the metallicity of the galaxy the older will be the
oldest BLs and the further back in time an accurate SFH can easily be
determined. BL stars are brighter than MS stars of the same mass,
often by more than a magnitude.

\subsection{The Red Giant Branch (RGB)}

The RGB is a very bright evolved phase of stellar evolution, where the star
is burning H in a shell around its He core.  For a given metallicity the
RGB red and blue limits are given by the young and old limits
(respectively) of the stars populating it (for ages $\gsim$1~Gyr).  As a
stellar population ages the RGB moves to the red, for constant metallicity,
the blue edge is determined by the age of the oldest stars.  However
increasing the metallicity of a stellar population will also produce
exactly the same effect as aging, and also makes the RGB redder.  This is
the (in)famous age-metallicity degeneracy problem.  The result is that if
there is metallicity evolution within a galaxy, it impossible to uniquely
disentangle effects due to age and metallicity on the basis of the optical
colours of the RGB alone.

\vskip.5cm
\hskip -.7cm
\psfig{figure=moriond_fig2.ps,height=8cm,width=8cm}
\vskip -6.2cm
\hskip 7.8cm
\begin{picture}(100,60)(0,0)
\put(0,0){\parbox{8.5cm}{\small Figure~2: In the top panel are plotted
the results of Caputo, Castellani \& Degl'Innocenti \cite{ccd} for the
variation in the {\it extent} in M$_V$ magnitude of a RC with age, for a
metallicity of Z=0.0004.  We plot the magnitude of the upper and lower edge
of the RC versus age, in Gyr.  We can thus clearly see that this extent is
strong function of the age of the stellar population.  Also plotted is
M$_V$ of the zero age HB against age.

In the bottom panel are plotted the results of running a series of
Monte-Carlo simulations \cite{et96} using stellar evolution models at
Z=0.0004 \cite{f94} and counting the number of RC and RGB stars in the same
part of the diagram, and thus we determine the expected ratio of RC/RGB
stars versus age.
}}
\end{picture}
\vskip4.3cm

\subsection{The Red Clump/Horizontal Branch (RC/HB)}

Red Clump (RC) stars and their lower mass cousins, Horizontal Branch (HB)
stars are core helium-burning stars, and their luminosity varies depending
upon age, metallicity and mass loss \cite{ccd}.  The extent in luminosity
of the RC can be used to estimate the age of the population that produced
it \cite{ccd}, as shown in the upper panel of Figure~2.  This age
measure is {\it independent of absolute magnitude and hence distance}, and
indeed these properties can be used to determine an accurate distance
measure on the basis of the RC \cite{c98}.

The classical RC and RGB appear in a population at about the same time
($\sim$ 0.9--1.5 Gyr, depending on model details), where the RGB are the
progenitors of the RC stars.  The lifetime of a star on the RGB, t$_{RGB}$,
is a strongly decreasing function of M$_{star}$, but the lifetime in the
RC, t$_{RC}$ is roughly constant.  Hence the ratio, t$_{RC}$ / t$_{RGB}$,
is a decreasing function of the age of the dominant stellar population in a
galaxy, and the ratio of the numbers of stars in the RC, and the HB to the
number of RGB is sensitive to the SFH of the galaxy \cite{et98, han97}.
Thus, the higher the ratio, N(RC)/N(RGB), the younger the dominant stellar
population in a galaxy, as shown in the lower panel of Figure~2.

The presence of a large HB population on the other hand (high N(HB)/N(RGB)
or even N(HB)/N(MS), is caused by a predominantly much older ($>$10~Gyr)
stellar population in a galaxy.  The HB is the brightest indicator of very
lowest mass (hence oldest) stellar populations in a galaxy.

\subsection{The Extended Asymptotic Giant Branch (EAGB)}

The temperature and colour of the EAGB stars in a galaxy are determined by
the age and metallicity of the population they represent (see Figure~3).
However there remain a number of uncertainties in the comparison between
the models and the data \cite{g94, L98}.  It is very important that more
work is done to enable a better calibration of these very bright indicators
of past star formation events.  In Figure~3 theoretical EAGB isochrones
\cite{b94} are overlaid on the HST CMD of a post-starburst BCD galaxy and we
can see that a large population of EAGB stars is a bright indicator of a
past high {\it sfr}, and the luminosity spread depends upon metallicity and
the age of the {\it sfr}.

\vskip -7.5cm
\hskip -1.cm
\psfig{figure=moriond_fig3.ps,height=15cm,width=15cm}
\vskip -5.1cm
\hskip 6.8cm
\begin{picture}(100,30)(0,0)
\put(0,0){\parbox{8.5cm}{\small Figure~3: EAGB isochrones \cite{b94}
for metallicities, Z=0.001 and Z=0.004, are shown superposed on the
observed CMD of VII~Zw403 \cite{L98}.  For each metallicity the isochrones
are for populations of ages 1.3, 2, 3, and 5 Gyrs, with the youngest
isochrone being the brightest.  This shows the potential discriminant
between the age and metallicity of older populations, if the models could
be better calibrated to a known SFH, {\it e.g.}  for a nearby EAGB rich system
like NGC~6822 where old MSTOs are observable.
}}
\end{picture}
\vskip 3.3cm

\subsection{Distance, Extinction \& Metallicity}

The accurate interpretation of the indicators described above depends
critically upon having reliable estimates for the distance, the extinction
and the metallicity of a galaxy.  Ideally we would also like to know if the
extinction is patchy and on what scale, and what has been the evolution of
the metallicity of the stellar population with time.

The basic properties of distance, extinction and metallicity can be
determined independently to the CMD, and they must be consistent with the
findings in a CMD.  These three basic parameters, in conjunction with
observational errors and incompleteness make the most significant impact on
the properties of the CMD and hence the final SFH model \cite{et96}.  There
are a number of difficulties in accurately determining these basic
properties but they can be resolved with careful observation and analysis
techniques.

\subsubsection{The Distance} is the most crucial parameter for accurate
analysis of a CMD, partly because it can easily be wrong by many orders of
magnitude (for example the young, red supergiants can be mistaken for the
RGB, if the observed CMD isn't deep enough to confirm the identification,
i.e.  by detecting a RC or HB).  If the distance to a galaxy is incorrect
this will result in the masses of individual stars being wrongly
determined, and hence the age of the different populations will be wrong.
Distances are most accurately determined by primary distance indicators
({\it e.g.}  RR~Lyr or Cepheid variable stars), but there is also useful
information in the tip of the RGB \cite{lfm}; the RC \cite{c98}; BLs
\cite{et98}.  To be sure of the distance to small faint galaxies it is
necessary to have a CMD which goes deep enough to extend below the RC/HB.

\subsubsection{The Extinction}, both internal to a galaxy and between us
and a galaxy can affect the accurate analysis of a CMD.  If the extinction
is incorrectly determined it will have the same effect as a distance error,
and hence effect the reliability of the SFH models.  Local HI maps in
conjunction with Infra-Red ({\it e.g.}  IRAS) 100$\mu$m maps can provide an
accurate picture of how much extinction can be expected in any given
direction in the sky \cite{g98}.

\subsubsection{Metallicity:} When a galaxy makes stars, then the detritus
of this process ({\it e.g.}, from SN explosions and stellar winds) make it
unlikely that the galaxy can avoid metallicity evolution altogether
\cite{els}.  However, there is no concrete observational evidence that this
is true, although abundance ratios of different elements do give us model
dependent suggestions \cite{p94}.  In the disc of our Galaxy, for example,
it was recently shown that, although there is a general trend in
metallicity evolution with time, the scatter is always large \cite{ed}.  We
do not understand in detail how stars interact with their surrounding ISM,
and thus how current star formation feeds the metal enrichment of future
generations.  Looking at recent results of absorption line studies of Zinc
abundances at cosmological distances ($z = 0.7 - 3.4$) there is evidence
for a shallow evolution of metallicity in galaxies over this long redshift
range, but there is also a large scatter in values at any time \cite{p97}.
Absorption line studies of these species provides arguably the most
reliable estimator of the metallicity of the {\it gas} in a galaxy.  If
suitable background continuum sources could be found behind nearby galaxies
this would dramatically improve our understanding of how the ISM in
different galaxies evolves and is affected by the proximity of current star
formation.

Accounting for metallicity evolution in a CMD is difficult.  It is
impossible to determine a unique model based solely on the RGB because of
age-metallicity degeneracy.  However, if metallicity evolution is neglected
in a CMD model then the best model for that galaxy will typically be
younger than if metallicity evolution were included \cite{et98}.

Understanding the details of metallicity evolution in galaxies is one of
the most critical areas for further study if we are to develop an accurate
understanding of galaxy evolution.

\section{Recent Results from {\sl HST} Observations}

An HST program was initiated by Skillman \cite{s98}, using four orbits of
telescope time per galaxy, in three filters (effectively B, V and I), to
study a sample of four nearby dwarf irregular (dI) galaxies.  The initial
sample consists of: Sextans~A, Pegasus, Leo~A \& GR~8.  The results have
been dramatic and illustrate the tremendous advances possible, even with
short exposures, when crowding has been virtually illuminated \cite{dp,
dp1, dp2, dp3, g98, s98, et98}.

\subsection{Leo A: A Predominantly Young Galaxy within the Local Group}

The unprecedented detail of the WFPC2 CMDs of the resolved stellar
population of Leo~A has resulted in an improved distance determination and
an accurate SFH for this extremely metal-poor Local Group (LG) dI galaxy
\cite{et98}.  From the position of the RC, the BLs and the tip of the RGB,
a distance modulus, m$-$M=24.2$\pm$0.2, or 690 $\pm$ 60 kpc, was obtained
which places Leo~A firmly within the LG.  The interpretation of these
features in the WFPC2 CMDs at this new distance based upon extremely low
metallicity (Z=0.0004) theoretical stellar evolution models suggests that
this galaxy is predominantly young, {\it i.e.} $<$~2~Gyr old.  A major
episode of star formation 900$-$1500~Gyr ago can explain the RC luminosity
and the ratio of N(RC)/N(RGB) stars as well as consistency with the the
number of anomalous Cepheid variable stars seen in this galaxy.  The
presence of an older, underlying globular cluster age stellar population
could not be ruled out with these data.  However, using the currently
available stellar evolution models, it would appear that such an older
population is limited to no more than 10\% of the total star formation to
have occured in this galaxy.  The HST CMDs and the modeling results are
shown below in Figure~4.

\hskip -0.5cm \centerline{
\psfig{figure=moriond_fig4.ps,height=15cm,width=15cm}} \vskip0.3cm
\begin{picture}(300,30)(0,0)
\put(0,0){\parbox{15cm}{\small Figure~4: Here we show the results for
the analysis of the HST/WFPC2 data \cite{et98}.  In a.  is the V$-$I, I HST
CMD for Leo~A, 1 orbit exposure time per filter.  In b.  is the B$-$V, V
HST CMD for Leo~A, 2 orbits in B (F439W).  In c.  is the best match
Monte-Carlo simulation model (in V$-$I, I) found for these data convolved
with the theoretical measurement error distribution \cite{ts}, and in d.
is the SFH that created the model CMD which best matches these data.  See
Tolstoy {\it et al.}  \cite{et98} for more details.
}}
\end{picture}
\vskip 1.5cm

\subsection{Pegasus: A Not so Young Galaxy?}

The resolved stellar population of the Pegasus dI galaxy reveals quite a
different SFH to Leo~A \cite{g98}.  A young ($<$ 0.5 Gyr), and weak MS
stellar component is also present.  In Pegasus however, the distinctive BLs
are not visible in the data.  This may be due to spatial variations in the
internal extinction properties of Pegasus which effectively smear out this
feature which would already be weak in a galaxy with such a small young
population.  The colours of the MS also suggest an unexpectedly large
foreground extinction of A$_V$ = 0.47 mag.  The width in colour of the RGB
implies a range of stellar ages and/or metallicities.  A small number of
EAGB stars are found beyond the RGB tip and in WIYN ground based imaging
\cite{g98} and near the faint limits of the HST data is a populous RC.
Fitting a self-consistent stellar population model based on the Z$=$0.001
Geneva stellar evolution tracks yielded a revised distance of 760 kpc.  The
numbers of MS and BL stars require that the {\it sfr} was higher in the
recent past, by a factor of $\sim$10 about 2~Gyr ago, assuming no
metallicity evolution.  Unique results cannot be obtained for the SFH over
longer time baselines without better information on stellar metallicities
and deeper photometry.  Even at its peak of star forming activity, Pegasus
most likely remained relatively dim with M$_V \sim -$14.  The HST CMDs and
the modeling results for Pegasus are shown in Figure~5 below.

\hskip -0.5cm \centerline{
\psfig{figure=moriond_fig5.ps,height=15cm,width=15cm}} \vskip0.3cm
\begin{picture}(300,30)(0,0)
\put(0,0){\parbox{15cm}{\small Figure~5: Here we show the results for
the analysis of the HST/WFPC2 data \cite{g98}.  In a.  is the V$-$I, I HST
CMD for Pegasus, 1 orbit exposure time per filter.  In b.  is the B$-$V, V
HST CMD for Pegasus, 2 orbits in B (F439W).  In c.  is the best match
Monte-Carlo simulation model \cite{ts}, in V$-$I, I, found for these data
({\it excluding the RC}) and convolved with the theoretical measurement
error distribution, and in d.  is the SFH that created the model CMD which
best matches the data.
See Gallagher {\it et al.}  \cite{g98} for more details.
}}
\end{picture}
\vskip 1.5cm

\subsection{Sextans~A \& GR~8: Detailed Star Formation Patterns}

Sextans~A and GR~8 are the furthest away in the Skillman sample (at 1.4 and
1.6 Mpc respectively) and so these data do not allow us to consider SFHs
beyond $\sim$800~Myr ago, however they do provide detailed information
about how star formation has varied spatially across these small galaxies
on time scales $<$~1~Gyr using the MS and BL stars.  There is insufficient
information to obtain unique information from the RGB about the older
populations from these data.  The Dohm-Palmer contribution to this volume
\cite{dp} discusses these results in detail, and see \cite{dp1, dp2, dp3}.

\subsection{VII~Zw 403: A Post-Starburst Blue Compact Dwarf Galaxy}

Another interesting new result from HST comes from a study of the nearest
by Blue Compact Dwarf (BCD) Galaxy, VII~Zw 403 by
Lynds {\it et al.}  \cite{L98}.
The (V$-$I, M$_V$) HST CMD is shown in Figure~3.  Another study of the same
HST observations of VII~Zw 403 is presented by Schulte-Ladbeck, in this
volume.  This galaxy is at a distance of $\sim$5~Mpc, and thus it of
similar resolution to ground based observations of nearby dI type galaxies,
such as NGC~6822 \cite{g94}.  The similarity between Figure~3 and the
ground-based CMD of NGC~6822 of Gallart {\it et al.} \cite{g94} is quite
startling.  Clearly this is a similarity which needs further study.
NGC~6822 is also close enough to calibrate the EAGB versus SFH via the
detection of older MSTOs.

\section{The Connection to High Redshift}

Star-forming, dI galaxies represent the largest fraction by number of
galaxies in the LG, and it is clear from deep imaging surveys that this
number count dominance appears to {\it increase} throughout the Universe
with lookback time \cite{e97}.  The large numbers of ``Faint Blue
Galaxies'' (FBG) found in deep imaging-redshift surveys appear to be
predominantly intermediate redshift ($z<1$, or a look-back time out to
roughly half a Hubble time), intrinsically {\it small} late type galaxies,
undergoing strong bursts of star formation \cite{bf96}.  Thus we can assume
that the dIs we see in the LG ({\it e.g.}
Leo~A, Pegasus, Sextans~A, etc.) are a
cosmologically important population of galaxies which can be used to trace
the evolutionary changes in the {\it sfr} of the Universe with redshift.
The ``Madau-diagram'' \cite{madau} uses the results of redshift surveys to
plot the SFH of the Universe against redshift.  It predicts that most of
the stars that have formed in the Universe have done so at redshifts, {\it
z} $\sim 1 - 2$.  If it is correct, then the MSTOs from the most active
period of star formation in the Universe will be easily visible as
7$-$9~Gyr old MSTOs in the galaxies of the LG \cite{Rich}.
Determining accurate SFHs
for all the galaxies in the local Universe using CMD analysis provides an
alternate route to and thus check upon the Madau-diagram.

Recent detailed CMDs of several nearby galaxies and self-consistent grids
of theoretical stellar evolution models have transformed our understanding
of galactic SFHs.  Both of the dIs we have looked at, and for which we
detected a RC, (Leo~A and Pegasus) agree that the {\it sfr} was higher in
the past, although the peak in the sfr has occured at relatively recent
times as defined by Madau-diagram (the peaks occur at z=0.1$-$0.2, within the
first bin).  The Mateo review of {\it all} LG dwarf galaxies \cite{mario}
and studies of M31 and our Galaxy \cite{Ren},
on the other hand, suggest that the LG
had its most significant peak in star formation $>$10~Gyr ago (i.e at
z~$>$~3), the epoch of halo formation.  Many galaxies contain large
numbers of RR~Lyr variables (or HB) and/or globular clusters which can only
come from a
significant older population.  It is possible that dI galaxies have quite
different SFHs to the more massive galaxies.  Thus although the small dI
galaxies in the LG have been having short, often intense, bursts of star
formation in comparatively recent times this is not representative of the
majority of the star formation in

\vskip -7cm
\centerline{
\psfig{figure=moriond_fig6.ps,height=10cm,width=10cm}}
\vskip 1.7cm
\begin{picture}(300,30)(0,0)
\put(0,0){\parbox{16cm}{\small Figure~6: In the upper panel is
a {\it rough} summation of the {\it sfr}s of the LG dwarf galaxies with
time (data taken from Mateo \cite{mario}) to obtain the integrated SFH of
all the LG dwarfs.  The redshifts corresponding to lookback times (for H$_0
= 50$, q$_0 = 0.5$).  In the middle panel, a wild extrapolation is made;
the assumption that the integrated SFH of the LG {\it dwarfs} in the upper
panel is representative of the Universe as a whole.  The resulting star
formation density of the LG versus redshift is plotted using the same
scheme as Madau {\it et al.} and Shanks {\it et al.} \cite{sha}, and these
two models are also plotted and the LG curve is {\bf arbitrarily}, and with
a very high degree of uncertainty, normalised to the other two models.  In
the lowest panel the The LG dwarf {\it sfr} as a fraction of the total star
formation integrated over all time is plotted versus redshift, and the
Madau curve is also replotted in this form, for the volume of the LG.  This
highlights the totally different distibution of star formation with
redshift found from galaxy redshift surveys and what we appear to
observe in the stellar population of the LG.
}}
\end{picture}
\vskip 3cm

\noindent{the LG.}  dIs represent a small fraction of the total
star formation in the LG. However direct observations of
the details of the oldest star forming episodes in any galaxy
are limited at best.  There
are only a few cases for which we have observations which can tell us not
only when the dominant epoch of star formation has been in a galaxy, but
also how intense this was.  This is an area where advanced CMD analysis
techniques have been developed \cite{ts} and telescopes with sufficient
image quality exist and the required deep, high quality imaging are
observations are waiting to be made.

Figure~6 summarises what can currently be said
about the SFH of the LG and how
this compares with the Madau {\it et al.} \cite{madau} and Shanks {\it et
al.} \cite{sha} redshift survey predictions.  We have not included the
dominant large galaxies in the LG, the Galaxy and M~31,
but the SFH of the combined dwarfs is broadly consistent with what is known
about the SFH of these large systems.  They have, as far as we can tell, had
a global {\it sfr} that has been gradually but steadily declining since
their (presumed) formation epoch $>$10~Gyr ago.  There is currently no
evidence for a particular peak in {\it sfr} around 7$-$9~Gyr ago or any
other time, as predicted by the Madau-diagram for either large galaxies
or dwarfs. Perhaps if dIs are singled out a population with a star formation
peak in the Madau-diagram range can be found. But at present the statistics
are too limited.
This is a question
that would be very useful to study again with HST data and modern CMD
analysis techniques.  There is
clearly a total mismatch between the SFH of the LG and the results
from the redshifts surveys.  This might hint at serious incompleteness
problems in high redshift galaxy surveys, which appear to miss passively
evolving systems in favour of small bursting systems.

The recent HST CMD results
give much cause for optimism that we can hope to sort
out in detail the SFH of all the different types of galaxies within in the
LG if only HST would point at them occasionally.  There is also great
potential for ground based imaging using high quality imaging telescopes
with large collecting areas, such as VLT is clearly going to be.

\vskip0.3cm
\noindent{{\it Acknowledgments:}} I thank Jay Gallagher, Mario Mateo,
Piero Rosati, Evan Skillman and Alvio Renzini for useful conversations.

\begin{moriondbib}

\bibitem{bf96}Babul A. \& Ferguson F. (1996) \apj {458} {100}
\bibitem{b94}Bertelli G. {\it et al.} (1994) \aas {106} {275}
\bibitem{ccd}Caputo F., Castellani V.,
Degl'Innocenti S. (1995) \aa {304} {365}
\bibitem{c98}Cole A.A. (1998) \apj {}{in press, astro-ph/9804110}
\bibitem{dp} Dohm-Palmer R.C. {this volume}
\bibitem{dp1}Dohm-Palmer R.C. {\it et al.}
(1997) \aj {114} {2527}
\bibitem{dp2}Dohm-Palmer R.C. {\it et al.} (1997) \aj {114} {2514}
\bibitem{dp3}Dohm-Palmer R.C. {\it et al.} (1998) \aj {}
{in press, September 1998}
\bibitem{ed}Edvardsson B. {\it et al.} (1993) \aa {275} {101}
\bibitem{els}Eggen O.J., Lynden-Bell D. \& Sandage A.R. 1962 \apj {136} {748}
\bibitem{e97} Ellis, R. (1997) {\it Ann. Rev. Astron. \& Astrophys.},
{\bf 35}, 389
\bibitem{f94}Fagotto F. {\it et al.} (1994) \aas {104} {365}
\bibitem{g98}Gallagher J.S. {\it et al.} (1998) \aj {115} {1869}
\bibitem{g94} Gallart C. {\it et al.} (1994) \apj {425} {9L}
\bibitem{han97}Han, M. {\it et al.} (1997) \aj {113} {1001}
\bibitem{hk98}Hurley-Keller D., Mateo M., Nemec J. (1998) \aj {115} {1840}
\bibitem{lfm}Lee, M. G.,  Freedman, W. L. \& Madore, B. F.
(1993) \apj {417} {553}
\bibitem{L98}Lynds R., Hunter D.A., O'Neil E.,
Tolstoy E. (1998) \aj {}{in press (July)}
\bibitem{madau}Madau P., Pozzetti L. \& Dickinson M. (1998) \apj {498} {106}
\bibitem{mario}Mateo M. (1998) {\it Ann. Rev. Astron. \& Astrophys.},
{\bf 36}, in press
\bibitem{p94}Pagel B.E.J. (1994) in
{\it The Formation and Evolution of Galaxies}, ed.
C. Mu\~{n}oz-Tu\~{n}\'{o}u \& F. S\'{a}nchez, CUP, p. 149
\bibitem{p97}Pettini M., Smith L.J., King D.L. \&
Hunstead R.W. (1997) \apj {486} {665}
\bibitem{Ren}Renzini A. (1998) in {\it The Young Universe}, eds.
S. D'Odorico {\it et al.}, p. 298
\bibitem{Rich}Rich M. (1998) in {\it Science with the NGST}, eds.
E.P. Smith \& A. Koratkar, p. 129
\bibitem{sha}Shanks T. {\it et al.} (1998) in {\it The Young Universe}, eds.
S. D'Odorico {\it et al.}, p.102
\bibitem{s98}Skillman E.D. (1998) {\it The Magellanic Clouds and other
Dwarf Galaxies}, eds. T. Richtler \& J.M. Braum
\bibitem{et96}Tolstoy E. (1996) \apj {462} {684}
\bibitem{ts}Tolstoy E. \& Saha A. (1996) \apj {462} {672}
\bibitem{et98}Tolstoy E. {\it et al.}
(1998) \aj {}{in press, astro-ph/9805268}

\end{moriondbib}
\vfill
\end{document}


X-shooter observations of QSO pairs

Abstract: Observations of quasar pairs represent a powerful tool in the study of the intergalactic medium, providing in particular information on the quasar radiative feedback not only along the line of sight, but also in the transverse direction. In this paper, we present the spectra of the four quasar pairs we observed so far with X-shooter, and we discuss two individual spectra affected by the presence of a close quasar in the foreground.

\section{Introduction: QSO pairs}

In the last decades, the analysis of Lyman-$\alpha$ and metal-line absorbers in the spectra quasars (QSOs) has dramatically improved our knowledge of the intergalactic medium (IGM) at intermediate redshifts ($z\sim 2$--$4$).
Regrettably, observations of isolated quasars provides information only along the line of sight.
To overcome this limitation, a suitable choice is to observe pairs and groups of quasar at small angular separation ($\sim$$1$--$10^\prime$), which allow us to obtain information in the transverse direction, and
assess the redshift space distortion due to IGM kinematics.

At present, suitable samples of spectra of QSO pairs are required in many fields.
Coincidences of absorption features along paired sightlines are useful to assess the size of both Ly-$\alpha$ absorbers (e.g., D'O\-dorico et al. 1998) and metal-line absorbers (e.g., Martin et al. 2010), constraining the IGM geometry and its physical and chemical state.
Pairs with large redshift separations make it possible to investigate the radiative feedback from quasars in 3D, revealing in the spectrum of the background quasar the local enhancement of the photoionization rate due to the foreground quasar (the so-called transverse proximity effect, or TPE; e.g., Crotts 1989; Fern\'andez-Soto et al. 1995; Gon\c calves, Steidel \& Pettini 2008).
In addition, accurate measurements of the auto- and cross-correlation of the Ly-$\alpha$ forest are expected to provide an independent estimation of the cosmological parameter $\Omega_\Lambda$, via an adapted version of the Alcock-Paczy\'nski (AP) test (e.g., McDonald 2003).
Such analysis requires simulations to properly reconstruct the 3D density field as a function of cosmology (e.g., Pichon et al. 2001).
The samples of QSO pairs collected so far (e.g., Coppolani et al. 2006, D'Odorico et al. 2006) are too small to perform
the AP
test.

In this framework the spectrograph X-shooter (see contributions by S. D'Odorico, J. Vernet, and F. Zerbi) represents a breakthrough.
Its intermediate resolution, extended spectral coverage, and high efficiency make it an ideal instrument to collect spectra of QSO pairs that would be too faint for the high-resolution spectrographs at the $8$--$10$ m class telescopes.
In this paper, we describe the present state of the X-shooter GTO program dedicated to the observation of QSO pairs and discuss two individual (and significantly different) cases of TPE in the spectra extracted so far.

\section{The X-shooter sample}

Four QSO pairs have been observed so far with X-shooter.
The first one (2QZ J0202--2805 and J0202--2804, at an angular separation $\Delta\theta=47.2^\second$) was already targeted in No\-vember, 2008, during the instrument commissioning.
We observed three more pairs (CTS 426 and 427, $\Delta\theta=58.2^\second$; SDSS J0111+1401 and J0111+1402, $\Delta\theta=35.8^\second$; 2QZ J0306--3010 and J0306\- --3011, $\Delta\theta=51.5^\second$) in October, 2009, within the GTO program. All quasar pairs have emission redshift $z\sim 2$--$3$ (Maza et al.~1995; Croom et al.~2001; Croom et al.~2004; Marble et al.~2008).
These observations were reduced into 2D spectra with the public release X-shooter pipeline (see contributions by A. Modigliani and P. Goldoni); we used the ESO-MIDAS package to extract the 1D spectra from the 2D ones.
The typical signal-to-noise ratio per wavelength bin (0.3 \AA) of the resulting spectra is $\sim$$30$--$60$ at the peak of the Ly-$\alpha$ emission, and $\sim$$10$--$40$ in the Ly-$\alpha$ forest and in the C \textsc{iv} forest.
These spectra provide a significative addition to the sample of quasar pairs and groups already observed with UVES (D'Odorico et al. 2006, Cappetta et al. 2010).
In the context of the GTO program, we expect to obtain $\sim$11 pairs, which combined with the pairs observed with UVES add up to a total sample of $\sim$27
pairs.
We are going to perform new simulations in order to assess the significance of the result we will be able to obtain with this sample, which according to McDonald (2003) should be
large enough to perform the AP test

Only in two cases (pairs 2 and 3) the redshift difference between the foreground and the background QSO is large enough to allow a positive assessment of the TPE. Fig.~\ref{fig:specfit} shows the regions of the background QSOs were the absorption signatures of the foreground QSOs (Ly-$\alpha$ line, N \textsc{v} $\lambda\lambda 1238, 1242$ and C \textsc{iv} $\lambda\lambda 1548, 1550$) are expected to be found. The following paragraphs describes the two pairs in further details.
We remark that TPE is by nature a statistical effect, so conclusions based on individual pairs should be regarded as tentative.

\begin{figure}
\center
\resizebox{0.90\hsize}{!}{\includegraphics[angle=270]{specfit_CTS0427.eps}}
\resizebox{0.90\hsize}{!}{\includegraphics[angle=270]{specfit_J0111p1402.eps}}
\caption{Regions of the background QSOs spectra around the foreground QSOs redshift. Upper panel: spectrum of CTS 427; lower panel: spectrum of J0111+1402. Normalized flux and error are shown in black and red, respectively. The blue line is a parametric fit of the absorption lines obtained with \texttt{FIT/LYMAN} in ESO-MIDAS.}
\label{fig:specfit}
\end{figure}

\paragraph{CTS 426 and 427.} The velocity difference between the two QSOs along the line of sight is $\Delta v\sim 10500$ km s$^{-1}$, corresponding to a proper distance of $\sim$$50h^{-1}$ Mpc.
The regions of interest of the spectrum of CTS 427 ($z_\textrm{em}=2.33\pm 0.02$) are shown in the upper panel of fig.~\ref{fig:specfit}.
Although no evident absorption is found at the redshift of CTS 426 ($z_\textrm{em}=2.215\pm 0.0044$, corresponding to $\Delta v=0$), we detected a system just $\sim$$590$ km s$^{-1}$ redwards (dotted vertical line), with very weak Ly-$\alpha$ absorption ($\log N_\textrm H=13.26\pm 0.08$) and evidence of consistent ionization ($\log N_\textrm{C \textsc{iv}}=13.62\pm 0.04$; possible N \textsc{v} doublet blended with other lines).
We interpret this observation as a signature of TPE in this pair.

\paragraph{SDSS J0111+1401 and J0111+1402.} This case is quite the opposite of the previous one.
The redshift difference between the two QSOs is the highest in our sample ($\Delta z\sim 0.45$).
Several Ly-$\alpha$ lines are observed in the spectrum of J0111+1402 ($z_\textrm{em}=2.93448\pm 0.001778$) around the redshift of J0111+1401, and a remarkable saturated absorption feature is recognizable approximately $650$ km s$^{-1}$ redwards the systemic redshift of J0111+1401, $z_\textrm{em}=2.48\pm 0.17$, estimated by us  from the O \textsc{i} $\lambda 1302$ line (a slightly lower value, $z_\textrm{em}=2.47$, has been published by Hennawi et al. 2006a).
The lower panel of fig.~\ref{fig:specfit} uses our new redshift value to define $\Delta v$.
The saturated Ly-$\alpha$ absorption is compatible with the presence of J0111+1401 at a proper distance, neglecting peculiar motions, of $\sim$$3.5h^{-1}$ Mpc (the transverse separation of J0111+1401 with respect to the line of sight to J0111+1402 is $\sim$$290h^{-1}$ kpc), and is associated to a lack of detected metal lines.
In this case, the enhanced ionization expected as a consequence of TPE is like\-ly masked by an anisotropic distribution of gas, due to clustering around the foreground QSO (see, e.g., Fern\'andez-Soto et al. 1995; Hennawi et al. 2006b).

Cosmology and Nongalactic Astrophysics (astro-ph.CO)

X-shooter observations of QSO pairs


Magnetic interaction at an interface between manganite and other transition metal oxides

Abstract: A general consideration is presented for the magnetic interaction at an interface between a perovskite manganite and other transition metal oxides. The latter is specified by the electron number $n$ in the $d_{3z^2-r^2}$ level as $(d_{3z^2-r^2})^n$. Based on the molecular orbitals formed at the interface and the generalized Hund's rule, the sign of the magnetic interaction is rather uniquely determined. The exception is when the $d_{3z^2-r^2}$ orbital is stabilized in the interfacial manganite layer neighboring to a $(d_{3z^2-r^2})^1$ or $(d_{3z^2-r^2})^2$ system. In this case, the magnetic interaction is sensitive to the occupancy of the Mn $d_{3z^2-r2}$ orbital. It is also shown that the magnetic interaction between the interfacial Mn layer and the bulk region can be changed. Manganite-based heterostructures thus show a rich magnetic behavior. We also present how to generalize the argument including $t_{2g}$ orbitals.

\section{Introduction}
Transition metal (TM) oxides have been one of the main subjects of materials science for decades.
Experimental and theoretical efforts are driven by their rich, complex, and potentially useful behaviors
originating from strong correlations between electrons and/or electrons and lattices.\cite{Imada98}
The recent developments in the crystal growth techniques, in particular the (laser) molecular-beam epitaxy,
have made us recognize the opportunity to further control their behaviors and
to generate phenomena that are not realized in the bulk systems
\cite{Izumi01,Ohtomo02,Ohtomo04,Okamoto04,Stahn05,Chakhalian06,Hoffmann05,Chakhalian07,Bhattacharya08}

Here, we focus on the magnetic behavior at an interface between perovskite manganite and other TM oxides.
Perovskite manganites, especially La$_{1-x}$Sr$_x$MnO$_3$ (LSMO),
are particularly important because of their ferromagnetic (F) metallic behavior
with relatively high Curie temperature $T_C$ and large polarization.
Controlling the magnetic interaction at interfaces involving manganites would cause a technological breakthrough for
electronic devices using, for example, a tunneling magnetoresistance (TMR) effect\cite{Bowen03,Ogimoto03}
and an exchange bias (EB) effect.\cite{Yu09
This requires the microscopic information on the orbital states, not only on the spin states
as demonstrated for cuprate/manganite interfaces in Refs.~\onlinecite{Chakhalian07} and \onlinecite{Veenendaal08}.
However, it remains controversial whether the magnetic moment is induced in the cuprate region\cite{Chakhalian06,Veenendaal08}
or the dead layers appear in the manganite region.\cite{Hoffmann05,Luo08}

The difficulty dealing with interfaces involving strongly-correlated electron systems comes from
the small volume fraction which makes the experimental analysis challenging, and
strong-correlation effects which hinder some of theoretical treatments.
Therefore, if a Goodenough-Kanamori-type \cite{Goodenough63,Kanamori59}
transparent description of the interfacial magnetic interaction becomes available,
both experiment and theory would greatly benefit.

In this paper, we present a general consideration for the magnetic interaction at an interface involving manganites.
We first focus on the interfacial interaction derived by $d_{3z^2-r^2}$ orbitals
which have the largest hybridization along the $z$ layer-stacking direction.
We see that the sign of the magnetic interaction via the $d_{3z^2-r^2}$ orbitals is naturally fixed
based on the molecular orbitals formed at the interface and the generalized Hund's rule.
The argument uses localized orbitals, and therefore shows only the qualitative trend.
The molecular orbitals effectively lift the degeneracy between $d_{3z^2-r^2}$ and $d_{x^2-y^2}$ orbitals
by the order of the hopping intensity.
In the second part, we perform the model Hartree-Fock calculation and show that the broken degeneracy
can lead to the additional change in the magnetic interaction between the interfacial Mn layer and its neighboring Mn layer.
We also discuss how to generalize the molecular-orbital based argument for more complicated situations including $t_{2g}$ orbitals.

\section{Molecular-orbital picture}

In this section, we consider the magnetic interaction between manganite and other TM oxides focusing on
the molecular orbitals formed by $d_{3z^2-r^2}$ orbitals which have the largest overlap at the interface.
The TM region is specified by the number of electrons occupying a $d_{3z^2-r^2}$ orbital.
Here, $t_{2g}$ electrons are assumed to be electronically inactive and considered as localized spins
when finite number of electrons occupy $t_{2g}$ orbitals.
Generalization including these electrons will be discussed later.

{\em $(d_{3z^2-r^2})^0$ system}.
Let us start from the simplest case,
an interface between Mn and a $(d_{3z^2-r^2})^0$ system (Fig.~\ref{fig:d0}).
In this case, the bonding (B) orbital is occupied by an electron whose spin is parallel to the localized $t_{2g}$ spin in Mn,
while the antibonding (AB) orbital is unoccupied.
When there are other unpaired electrons in the $(d_{3z^2-r^2})^0$ system at $d_{x^2-y^2}$ and/or $t_{2g}$ orbitals,
their spins align parallel to that of the electron in the B orbital due to the Hund coupling.
Thus, the F coupling is generated between Mn and $(d_{3z^2-r^2})^0$ systems.
This is equivalent to the double-exchange (DE) interaction originally proposed by Zener.\cite{Zener51}
When $d_{x^2-y^2}$ is much lower in energy than $d_{3z^2-r^2}$ and in the interfacial Mn layer (termed $d_{x^2-y^2}$ order),
Mn and $(d_{3z^2-r^2})^0$ systems are virtually decoupled.
Thus, the magnetic coupling is due to the superexchange (SE) interaction between $t_{2g}$ electrons.
This interaction is either F or antiferromagnetic (AF) depending on the orbital state and the occupancy of the TM $t_{2g}$ level.

\begin{figure}[tbp]
\includegraphics[width=0.6\columnwidth,clip]{d0}
\caption{(Color online) Molecular orbital (middle) formed by $d_{3z^2-r^2}$ orbitals on Mn (right) and
TM with the $(d_{3z^2-r^2})^0$ configuration (left). }
\label{fig:d0}
\end{figure}

{\em $(d_{3z^2-r^2})^{1,2}$ normal}.
This simple consideration can be easily generalized to $(d_{3z^2-r^2})^1$ and $(d_{3z^2-r^2})^2$ systems.
First we consider that the $d_{3z^2-r^2}$ and $d_{x^2-y^2}$ are nearly degenerate in the interfacial Mn layer and
the unoccupied $d_{x^2-y^2}$ level in the TM region is much higher than the $d_{3z^2-r^2}$ level
(Fig.~\ref{fig:d12}, top figures).
We call this configuration ``normal'' (N) configuration.
In the lowest energy configuration, B orbitals and the Mn $d_{x^2-y^2}$ orbital are occupied by electrons.
For the $(d_{3z^2-r^2})^1$ system, the F interaction is favorable as in the $(d_{3z^2-r^2})^0$ system.
On the other hand, for the $(d_{3z^2-r^2})^2$ system, the down electron orbital is hybridized with the minority band in the Mn region.
Thus, the ``down'' B orbital is higher in energy and has larger weight on the TM than the ``up'' B orbital.
Because of the Hund coupling with the ``down'' electron in the B orbital,
other unpaired electrons, if they exist in $d_{x^2-y^2}$ and/or $t_{2g}$ orbitals,
tend to be antiparallel to the Mn spin.

Since $d_{x^2-y^2}$ orbitals are predominantly occupied in the interfacial Mn layer
due to the B/AB splitting of $d_{3z^2-r^2}$-based molecular orbitals,
further stabilization of $d_{x^2-y^2}$ orbitals in the Mn region, i.e., $d_{x^2-y^2}$ order,
would not affect the interfacial magnetic coupling discussed here.
But, this could reverse the magnetic coupling between the interfacial Mn layer and the second Mn layer as discussed in the next section.

{\em $(d_{3z^2-r^2})^{1,2}$ anomalous}.
When the $d_{x^2-y^2}$ level in the TM region becomes lower than the Mn $d_{x^2-y^2}$ level, the charge transfer occurs.
We shall call this configuration ``anomalous'' (AN) configuration (Fig.~\ref{fig:d12}, middle figures).
The electron transferred to the TM $d_{x^2-y^2}$ orbital has the same spin
as the higher energy B orbital due to the Hund coupling (indicated by arrows).
Therefore, the sign of the magnetic coupling between the Mn and $(d_{3z^2-r^2})^{1,2}$ systems is unchanged.

Note that this argument is applicable when the hopping probability between $d_{x^2-y^2}$ orbitals in
the Mn and the TM regions is negligibly small.
The finite hopping probability would make the charge transfer continuous.
Furthermore, when the hopping probability becomes large, the DE interaction is generated.
Although the DE interaction through $d_{x^2-y^2}$ bonds may not be realistic,
it cooperatively stabilizes the F spin alignment for the $(d_{3z^2-r^2})^1$ case,
while it competes with the AF tendency for the $(d_{3z^2-r^2})^2$ case.

Magnetic interactions discussed so far are insensitive to the electron density in the interfacial Mn
because the interactions are mainly derived from the virtual electron excitation from the occupied $d_{3z^2-r^2}$ orbital in the TM region
to the unoccupied counterpart in the Mn region.

Next, we consider that the $d_{3z^2-r^2}$ level is much lower than the $d_{x^2-y^2}$ in the interfacial Mn layer
due to either the local Jahn-Teller distortion or compressive strain originating from the substrate
(Fig.~\ref{fig:d12}, lower figures denoted by ``JT'').
The magnetic coupling in this case is sensitive to the electron density of the interfacial Mn.

\begin{figure}[tbp]
\includegraphics[width=0.8\columnwidth,clip]{d12}
\caption{(Color online) Molecular orbitals formed by $d_{3z^2-r^2}$ orbitals on Mn and
the $(d_{3z^2-r^2})^1$ system (left column) and the $(d_{3z^2-r^2})^2$ system (right column).
In the normal (anomalous) configurations, $d_{3z^2-r^2}$ and $d_{x^2-y^2}$ orbitals are nearly degenerate in the interfacial Mn,
and the unoccupied $d_{x^2-y^2}$ orbital in the neighboring TM is higher in energy (lower in energy than the occupied Mn $d_{x^2-y^2}$).
In the JT case, the $d_{3z^2-r^2}$ level is significantly lower than the $d_{x^2-y^2}$ level.
Black (light) lines indicate the level of majority (minority) spins.
The up level and down level are exchange split resulting in the level scheme as indicated.
The minority levels are neglected in the upper left two because these are irrelevant.}
\label{fig:d12}
\end{figure}

{\em $(d_{3z^2-r^2})^1$ JT}.
When the Mn $d_{3z^2-r^2}$ density is close to 1, the SE interaction between the occupied $d_{3z^2-r^2}$ orbitals becomes
AF.
On the other hand, when the density is much less than 1, the F interaction between $(d_{3z^2-r^2})^0$ configuration on Mn and
$(d_{3z^2-r^2})^1$ becomes dominant.

{\em $(d_{3z^2-r^2})^2$ JT}.
When the Mn $d_{3z^2-r^2}$ occupancy is close to 1,
``up'' electrons are localized on each sites because both B and AB molecular orbitals are occupied while down electrons can be excited or leaked
from the $(d_{3z^2-r^2})^2$ system to the Mn minority level, i.e., down electron density is virtually reduced in the TM region.
As a result, unpaired spins, if they exist in $d_{x^2-y^2}$ and/or $t_{2g}$ orbitals,
become parallel to the up spin, i.e., F coupling.
When the Mn $d_{3z^2-r^2}$ density becomes much less than 1, the up AB orbital becomes less occupied while keeping the occupancy of
B orbitals relatively unchanged.
Eventually, the down density in the TM region becomes larger than the up density,
and the magnetic coupling between the Mn and $(d_{3z^2-r^2})^2$ regions becomes AF.

\section{Model Hartree-Fock analysis}

In the previous section, we discussed the interfacial magnetic coupling controlled by the molecular orbitals.
The separation between B and AB molecular levels can become as large as the order of
$t$, the hybridization between $d_{3z^2-r^2}$ orbitals along the $z$ direction.
Since the interfacial Mn $d_{3z^2-r^2}$ band is represented by the B (AB) $d_{3z^2-r^2}$ orbital
for a $(d_{3z^2-r^2})^{0(1,2)}$/manganite interface,
the $e_g$ degeneracy is effectively lifted in the interface layer.
This degeneracy lifting is expected to affect the magnetic interaction in the Mn region.
In this section, we discuss this effect using the microscopic model calculation.

We consider a two-band DE model given by
\begin{eqnarray}
H \!\!&=&\!\! \sum_{i} \Delta n_{i \alpha}
-\sum_{\langle ij \rangle a b} \bigl\{ t_{ij}^{ab} U_{ij} d_{i a}^\dag d_{j b} + h.c. \bigr\} \nonumber \\
&& + \sum_i \tilde U n_{i \alpha} n_{i \beta} + J \sum_{\langle ij \rangle} \vec S_{t i} \cdot \vec S_{t j}.
\label{eq:Hamiltonian}
\end{eqnarray}
Here, an electron annihilation operator at site $i$ and orbital $a [= \alpha (d_{3z^2-r^2}),\beta (d_{x^2-y^2})]$ is given by $d_{i a}$,
$n_{i a} = d_{ia}^\dag d_{ia}$, and the level difference between $\alpha$ and $\beta$ is given by $\Delta$.
We consider the large Hund coupling limit, in which
the spin direction of a conduction electron is always parallel to that of a localized $t_{2g}$ spin on the same site,
and omit the spin index.
Instead, the relative orientation of $t_{2g}$ spins is reflected in the hopping matrix;
$U_{ij}$ is the unitary transformation representing the rotation of the spin direction between sites $i$ and $j$.
For simplicity, we only consider nearest-neighboring (NN) hoppings between Mn $e_g$ orbitals via oxygen $2p$ in the middle.
Using the Slater-Koster scheme,\cite{Slater54}
the orbital dependence of $t_{ij}^{ab}$ is written as
$t_{i, i+z}^{\alpha \alpha} = 4 t_{i, i+x(y)}^{\alpha \alpha} = t$,
$t_{i, i+x(y)}^{\beta \beta}= \frac{3t}{4}$,
$t_{i, i+x(y)}^{\alpha \beta}= t_{i, i+x(y)}^{\beta \alpha} = (-)\frac{\sqrt{3}t}{4}$, and
$t_{i, i+z}^{\alpha \beta, \beta \alpha}=t_{i, i+z}^{\beta \beta}= 0$.
The third term represents interorbital Coulomb interaction.
Due to the $e_g$ symmetry, $\tilde U$ is related to the intraorbital Coulomb interaction $U$ and
the interorbital exchange integral $J_H$ as $\tilde U = U- 3J_H$.
The last term represents the AF SE interaction between NN $t_{2g}$ spins $|\vec S_t|=\frac{3}{2}$.

From the optical measurements, the on-site interactions are estimated as $U \sim 3$~eV and $J_H \sim 0.5$~eV.\cite{Kovaleva04}
The density-functional theory calculation provides $t \sim 0.5$~eV.\cite{Ederer07}
Using the mean-field analysis for the N{\'e}el temperature $\sim 120K$ of CaMnO$_3$,
one estimates $J \sim 1$~meV.\cite{Wollan55}
A similar value is obtained from the magnon excitations in the A-AF phases of
50~\% doped Pr$_{1-x}$Sr$_x$MnO$_3$ and Nd$_{1-x}$Sr$_x$MnO$_3$
supposing that the AF interaction is due to the same $J$.\cite{Kawano03}
Thus, in what follows, we take $\tilde U=3t$.
Considering some ambiguity, the realistic value for $JS_t^2/t$ is expected to be
$\sim 0.01$--0.05.

We analyze the model Hamiltonian, Eq.~(\ref{eq:Hamiltonian}), using the Hartree-Fock approximation at $T=0$
focusing on the doped region (carrier density $N$ far away from 1).
In light of the experimental reports,
we compare the energy of the following eight magnetic orderings:
F ordering,
planar AF ordering in which spins align ferromagnetically in the $xy$ ($xz$ or $yz$) plane [A (A')],
chain-type AF ordering in which spins align ferromagnetically along the $z$ ($x$ or $y$) direction [C (C')],
zigzag AF in which spins form ferromagnetic zigzag chains in the $xy$ ($xz$ or $yz$) plane [CE (CE')],
and NaCl-type AF (G).
At $N \rightarrow 1$, in addition to the spin symmetry breaking, orbital symmetry can be broken
due to the SE mechanism in the present model.\cite{Kugel82}
Since we are focusing on the metallic regime $N<1$, we do not consider such a symmetry breaking.

The numerical results for the bulk phase diagram are presented in Figs.~\ref{fig:pd}~(a)-\ref{fig:pd}~(c).
Here, all phase boundaries are of first order, and
those at small $N$ can be replaced by canted AF phases or the phase separation between the undoped G-AF phase and doped F or AF phases.
The overall feature is consistent with the previous theoretical reports.\cite{Maezono98,Brink99a,Fang00}
At $\Delta=0$, A-AF and A'-AF (C- and C'-, CE- and CE'-) are degenerate but the degeneracy is lifted by the finite $\Delta$.
We found the CE phase at $\tilde U=\Delta = 0$ at $JS_t^2 \agt 0.112 t$ and $N \agt 0.5$ (not shown)
as in the previous reports.\cite{Solovyev99,Brink99b,Brey05}
At $\tilde U = 3t$, the CE phase becomes unstable against A- and C-AF phases
and appears only at the positive $\Delta$ with $JS_t^2 \agt 0.1t$.
$JS_t^2 \sim 0.05t$ reproduces the phase diagram of a high $T_C$ system
such as LSMO and Pr$_{1-x}$Sr$_x$MnO$_3$ (Refs. \onlinecite{Jirak01} and \onlinecite{Chmaissem03} fairly well.

\begin{figure}[tbp]
\includegraphics[width=0.8\columnwidth,clip]{pd}
\caption{[(a)-(c)] Mean-field phase diagrams of doped manganites as a function of electron density $N$
and the AF interaction $J$
for three choices of the level difference between $e_g$ orbitals $\Delta$.
At $\Delta< (>) 0$, $d_{3z^2-r^2}$ is lower (higher) in energy than $d_{x^2-y^2}$ .
For notations of the magnetic phases, see the main text.
(d) Phase diagram for the 20-layer slab with $\Delta=t$ in the surface layers.
$N$ in this case corresponds to the mean electron density.
For A1 and A2 phases, schematic spin alignments are also shown.
A dashed line is the phase boundary between F and A-AF phases in the bulk calculation. }
\label{fig:pd}
\end{figure}

The main effect of the level separation $\Delta$ is changing the stability of planar-type AF (A or A') with respect to the
chain-type AF (C or C') and F states.
In particular, the A-AF phase is stabilized by the positive $\Delta$ more strongly than the C-AF phase by the negative $\Delta$.
This is because the energy gain by the DE mechanism is favorable for the A-AF than the C-AF.
The result is semiquantitatively consistent with the previous report based on the density-functional theory.\cite{Fang00}
At $\Delta=t$, the boundary between F and A-AF phases is moved down to
$JS_t^2 \sim 0.02t$ at $0.3 \alt N \alt 0.7$.
This behavior suggests that, when the $d_{3z^2-r^2}$ AB level for the $(d_{3z^2-r^2})^{1,2}$/manganite interfaces
is about $t$ higher than the Mn $d_{x^2-y^2}$ level,
the magnetic coupling between the interfacial Mn and the second Mn layers is switched to AF while retaining the intraplane F coupling.

We confirmed this behavior by computing the surface phase diagram considering F phase and two AF phases:
A1(2) where the surface layer (and the second layer) is antiferromagnetically coupled to its neighbor.
We introduce positive $\Delta$ only on the surface layers in the 20-layer slab.
As shown in Fig.~\ref{fig:pd} (d), a large part of F phase is replaced by A1 phase compared with the bulk phase diagram (b).
(Precise phase boundary requires detailed information of the surface or interface.)
Although the parameter regime is small,
it is also possible that surface three layers are AF coupled while the other couplings remain F, A2 phase,
before the whole system enters A-AF when $J$ is increased or $N$ is decreased.
When the $d_{3z^2-r^2}$ orbital is stabilized,
the inter-Mn-layer coupling remains F but the intraplane F coupling is reduced.
Therefore, in-plane canted AF structure may result for small $N$.

\section{Summary and discussion}

Summarizing, we presented a general consideration on the magnetic interaction between the doped manganite and other transition metal oxides
when an interface is formed.
Using the molecular orbital formed at the interface and the generalized Hund's rule,
the sign of the magnetic interaction is determined (Sec. II).
The bonding/antibonding splitting of the molecular orbitals leads to the degeneracy lifting of $e_g$ orbitals on the interface Mn layer.
Further, the bulk strain lifts the $e_g$ degeneracy.
These effects control the magnetic interaction in the interfacial Mn plane and between the interfacial Mn plane and its neighbor (Sec. III).
Considering these effects, we summarized the magnetic couplings in $(d_{3z^2-r^2})^{n}$/manganite interfaces
in Table~\ref{tab:coupling}.
Although the present argument is rather qualitative,
it is physically transparent and can be applied to a variety of systems.
It is also straightforward to generalize the argument to include other orbitals.
Therefore, the present argument will also help a more quantitative analysis
with detailed information from either the experiment or the first principle theory.

\begin{table}[tbp]
\caption{Magnetic interaction at an interface between Mn and TM with the $(d_{3z^2-r^2})^n$ configuration.
The interfacial Mn is indicated by Mn(1), and Mn in the second layer by Mn(2).
Mn(1)-Mn(1) indicates intraplane interaction while the others interplane interactions.
The TM-Mn(1) interaction is based on the molecular-orbital picture presented in Sec. II
while the Mn-Mn interaction is based on the model Hartree-Fock study presented in Sec. III.
At $d_{x^2-y^2}$ order, $d_{x^2-y^2}$ orbital is stabilized at the (interfacial) Mn layer.
At F*, Mn-Mn interaction is weak, and the canted AF ordering may result.
See the stabilization of the C-AF phase by the JT-type distortion $\Delta<0$ in Fig.~\ref{fig:pd} (a),
the stabilization of the C- and A-AF phases by reducing the carrier density $N$ in Fig.~\ref{fig:pd} (b),
and the stabilization of the A1 phase by the interfacial $d_{x^2-y^2}$ order in Fig.~\ref{fig:pd} (d).
}
\label{tab:coupling}
\begin{center}
\begin{tabular}{ccccc} \hline \hline
$n$ & Condition & TM-Mn(1) & Mn(1)-Mn(1) & Mn(1)-Mn(2) \\
\hline
0 & N \& JT & F & F* & F \\
  & N w/ $d_{x^2-y^2}$ order & AF & F & AF \\
1 & N & F  & F & F* \\
  & N w/ $d_{x^2-y^2}$ order & F &F & AF \\
  & AN & F  & F* & F* \\
  & JT w/ $N \sim 1$ & AF & F* & F \\
  & JT w/ small $N$ & F & F* & F\\
2 & N  & AF & F & F* \\
  & N w/ $d_{x^2-y^2}$ order & AF & F & AF \\
  & AN & AF & F* & F* \\
  & JT w/ $N \sim 1$ & F & F* & F \\
  & JT w/ small $N$  & AF & F* & F \\
\hline \hline
\end{tabular}
\end{center}
\end{table}

It is worth discussing the implication of the present results to the real systems.
An example of the $(d_{3z^2-r^2})^2$ system is high-$T_c$ cuprate.
It has been reported that the magnetic coupling between YBa$_2$Cu$_3$O$_7$ (YBCO) and
La$_{1-x}$Ca$_x$MnO$_3$ is AF,\cite{Chakhalian06}
and $d_{3z^2-r^2}$ and $d_{x^2-y^2}$ in the interfacial Cu have a similar amount of holes.\cite{Chakhalian07}
This corresponds to the AN situation.
F coupling due to the DE remains in the Mn region
because of the finite band width of $d_{x^2-y^2}$.
An example of the $(d_{3z^2-r^2})^1$ system is BiFeO$_3$ (BFO).
Recently, the EB effect was reported at BFO/LSMO interfaces accompanying the ``AF'' coupling
between BFO and LSMO.\cite{Yu09}
We expect the N situation with $d_{x^2-y^2}$ ordering at this interface.
Although the interfacial coupling is F,
the AF coupling between the interfacial Mn and the second Mn layers results in the AF alignment between BFO and bulk LSMO
as observed experimentally and is responsible for the exchange bias effect.

A question one may ask is what causes the ``AN situation'' in YBCO and the ``N situation'' in BFO?
A qualitative explanation is as follow:
in YBCO, the unoccupied Cu $d_{x^2-y^2}$ state is right above the Mott gap and its position is
nearly identical to the occupied band of manganites.\cite{Yunoki07}
Therefore, the charge transfer from Mn $e_g$ to Cu $d_{x^2-y^2}$ can easily occur.
On the other hand, the high-spin state is realized in BFO, and
the unoccupied $d_{x^2-y^2}$ state with opposite spin with respect to the majority electrons is located far above the gap.
In addition, the very close chemical potentials (i.e. close $d_{3z^2-r^2}$ levels) of BFO (Ref.~\onlinecite{Paradis05}) and
LSMO (Ref.~\onlinecite{Jong03}) maximize the B and AB splittings.
This situation is favorable for the $d_{x^2-y^2}$ ordering in the interfacial Mn layer and
the resulting AF coupling between the first and the second Mn layers [see Fig.~\ref{fig:pd} (d)].

Finally, an example of the $(d_{3z^2-r^2})^0$ system may be non-magnetic SrTiO$_3$,
and the coupling with this is expected to affect the magnetic state near the interfacial Mn.
For small doping $x$ of LSMO,
the coupling with SrTiO$_3$ (with the smaller lattice constant of SrTiO$_3$) increases the $d_{3z^2-r^2}$ orbital occupancy
suppressing the inplane DE effect.
For large doping, SrTiO$_3$ creates the tensile strain stabilizing $d_{x^2-y^2}$, and the out-of-plane F coupling is reduced.\cite{Ogimoto03}
Both are expected to cause a more rapid decrease in the ordered moment with increasing temperature
than in the bulk region,\cite{Okamoto09}
resulting in the rapid suppression of the TMR effect in LSMO/SrTiO$_3$/LSMO junctions.\cite{Bowen03,Ogimoto03}
The in-plane (out-of-plane) spin canting may also be realized in the former (latter).\cite{Ogimoto03}
For undoped LaMnO$_3$, the out-of-plane ferromagnetic coupling may result
because the overlap between the occupied $d_{3z^2-r^2}$ in the first Mn layer and the unoccupied $d_{x^2-z^2}$ or $d_{y^2-z^2}$ orbitals
in the second Mn layer is increased,
favorable for the F SE interaction between Mn layers.

However, since $t_{2g}$ orbitals in titanates are located near (slightly above) the Fermi level of manganite,\cite{Yunoki07}
one may need to consider $t_{2g}$ orbitals more carefully as discussed below.

\begin{figure}[tbp]
\includegraphics[width=0.6\columnwidth,clip]{TiMn}
\caption{(Color online) Molecular orbitals formed by $3d$ orbitals on Mn and Ti, originally $d^0$.
Here, only bonding orbitals are shown.
(a) Full level diagram including both $e_g$ and $t_{2g}$.
Black (light) lines indicate the level of majority (minority) spins.
The highest occupied molecular orbitals and the magnetic alignment
depend sensitively on the detail of the interface as shown in (b) and (c).
(b) [(c)] The up B orbital of $d_{3z^2-r^2}$ orbital is lower (higher) in energy than
the down B orbitals of $d_{xz,yz}$.
In (b), induced magnetic moment in Ti is parallel to Mn, i.e., $(d_{3z^2-r^2})^0$ configuration, while
in (c), it depends on the relative occupancy of Ti $d_{xz,yz}$ orbitals in the up and down B orbitals.
When the occupancy of the Ti down $d_{xz,yz}$ orbitals is larger than the up $d_{xz,yz}$ orbitals,
net moment induced in Ti site becomes antiparallel to the Mn moment.
}
\label{fig:TiMn}
\end{figure}

{\em Extention to $t_{2g}$ systems}.
In $t_{2g}$ systems such as titanates, vanadates, and cromates,
coupling between $t_{2g}$ orbitals could become as important as the coupling between $e_g$ orbitals.
Here, we discuss how to generalize the molecular-orbital argument presented in Sec. II to $t_{2g}$ systems.
As an example, we consider an interface between titanate with the $d^0$ configuration and manganites.
Extending the argument to other systems is straightforward.

Figure \ref{fig:TiMn} (a) shows the level diagram of the titanate/manganite interface including both $e_g$ and $t_{2g}$ orbitals.
For simplicity, only bonding orbitals are presented.
Because the $d_{3z^2-r^2}$ level in titanate is far above the occupied levels in manganite
and the unoccupied $t_{2g}$ levels in titanate and manganite (down electrons for the latter) are close,\cite{Yunoki07}
highest occupied molecular orbitals could be either B up $d_{3z^2-r^2}$ or $d_{x^2-y}$ orbital
[Fig.~\ref{fig:TiMn} (b) which is equivalent to Fig.~\ref{fig:d0}]
or B down $d_{xz,yz}$ orbitals [Fig.~\ref{fig:TiMn} (c)].
Note that the interfacial hybridization between $d_{xy}$ orbitals on Ti and Mn is much smaller than those between $d_{xz}$ and between $d_{yz}$.

In the case of Fig.~\ref{fig:TiMn} (b), induced moment in the titanate region is tiny but parallel to the moment in manganite region.
On the other hand in the case of Fig.~\ref{fig:TiMn} (c),
the induced moment in the titanate region could be either parallel or antiparallel to the manganite moment.
This depends on the relative weight of the down electron density in the B $d_{xz,yz}$ orbitals
with respect to the up electron density in the B $d_{xz,yz}$ orbitals.
The situation in Fig.~\ref{fig:TiMn} (c) with antiparallel spin arrangement between titanate and manganite could happen when
the original electron density in the manganite $e_g$ orbital is large and $d_{3z^2-r^2}$ level both in titanate and manganite is high
due, for example, to the in-plane tensile strain.
But in general, the difference between two configurations, Figs.~\ref{fig:TiMn} (b) and ~\ref{fig:TiMn} (c)
with either parallel or antiparallel spin configurations, would be subtle.
Therefore, depending on a variety of condition such as the sample preparation, any situation could be realized.

When the number of $t_{2g}$ electrons is increased, such as doped titanates, vanadates, and cromates,
electrons tend to enter the down B $d_{xz,yz}$ orbitals and, then, the down B $d_{xy}$,
resulting in the antiparallel spin configuration.
However, the antiparallel configuration becomes unstable against the parallel configuration
when the electron number in $t_{2g}$ orbitals becomes large and
the level separation between $t_{2g}$ and $e_g$ orbitals, i.e., $10Dq$, becomes relatively small.

In this case, because of the strong on-site Coulomb interactions,
the energy gain by forming B orbitals becomes small for $t_{2g}$ electrons
and comparable to having electrons in both B and AB orbitals with the parallel spin configuration.
The parallel configuration further lowers the energy by forming $d_{3z^2-r^2}$ B orbital and
by the Hund coupling between the $d_{3z^2-r^2}$ B orbital and $t_{2g}$ electrons on the $t_{2g}$ system,
i.e., the Zener's double-exchange ferromagnetism discussed in Sec.~II.

When there are more than three $d$ electrons with relatively large $10Dq$, a low spin state is realized.
In this case, three electrons enter B orbitals formed with $t_{2g}$ minority bands of Mn and
remaining electrons enter AB orbitals formed with $t_{2g}$ majority band of Mn.
Thus, the antiparallel configurations persist.
Such a situation may be realized in, for example, an interface between manganites and SrRuO$_3$ in which Ru$^{4+}$ is in a low spin state with $t_{2g}^4$.
This AF configuration can be turned to the F configuration when the double-exchange-type interaction becomes dominant
due to the formation of $d_{3z^2-r^2}$ B orbital.\cite{Panagopoulos10}

So far, we have considered the ideal lattice structure in which orbitals with different symmetry do not hybridize.
In reality, bond angle formed by two transition metal ions and an oxygen ion in between becomes smaller than 180$^\circ$
allowing electrons to hop between orbitals with different symmetry.
As a result, additional magnetic channels are generated.
A simple argument presented in this paper can be generalized to deal with such a situation.

\acknowledgments
The author thanks P. Yu, R. Ramesh, J. Santamaria, and C. Panagopoulos
for stimulating discussions and sharing the experimental data prior to publication,
J. Kune{\v s} for discussion,
and the Kavli Institute of Theoretical Physics, University of California Santa Barbara, which is supported in part by the National Science Foundation under Grant No. PHY05-51164, for hospitality.
This work was supported by the Materials Sciences and Engineering Division, Office of Basic Energy Sciences, U.S. Department of Energy.