WGANSing: A Multi-Voice Singing Voice Synthesizer Based on the Wasserstein-GAN

Abstract: We present a deep neural network based singing voice synthesizer, inspired by the Deep Convolutions Generative Adversarial Networks (DCGAN) architecture and optimized using the Wasserstein-GAN algorithm. We use vocoder parameters for acoustic modelling, to separate the influence of pitch and timbre. This facilitates the modelling of the large variability of pitch in the singing voice. Our network takes a block of consecutive frame-wise linguistic and fundamental frequency features, along with global singer identity as input and outputs vocoder features, corresponding to the block of features. This block-wise approach, along with the training methodology allows us to model temporal dependencies within the features of the input block. For inference, sequential blocks are concatenated using an overlap-add procedure. We show that the performance of our model is competitive with regards to the state-of-the-art and the original sample using objective metrics and a subjective listening test. We also present examples of the synthesis on a supplementary website and the source code via GitHub.

\section{Introduction}
Singing voice synthesis and Text-To-Speech (TTS) synthesis are related but distinct research fields. While both fields try to generate signals mimicking the human voice, singing voice synthesis models a much higher range of pitches and vowel durations. In addition, while speech synthesis is controlled primarily by textual information such as words or syllables, singing voice synthesis is additionally guided by a score, which puts constraints on pitch and timing. These constraints and differences also cause singing voice synthesis models to deviate somewhat from their speech counterparts.
Historically, both speech and singing voice synthesis have been based on concatenative methods, which involve transformation and concatenation of waveforms from a large corpus of specialized recordings. Recently, several machine learning based methods have been proposed in both fields, most of which also require a large amount of data for training.  In terms of quality, the field of TTS has seen a revolution in the last few years, with the introduction of the WaveNet \cite{oord2016wavenet} autoregressive framework, capable of synthesizing speech virtually indistinguishable from a real voice recording. This architecture inspired the Neural Parametric Singing Synthesiser (NPSS) \cite{blaauw2017neural}, a deep learning based singing voice synthesis method which is trained on a dataset of annotated natural singing and produces high quality synthesis.

The WaveNet \cite{oord2016wavenet} directly generates the waveform given local linguistic and global speaker identity conditions. While a high quality synthesis is generated, the drawback of this model is that it requires a large amount of annotated data. As such, some following works, like the Tacotron 2 \cite{shen2018natural}, use the WaveNet as a vocoder for converting acoustic features to a waveform and use a separate architecture for modelling these acoustic features from the linguistic input. The WaveNet vocoder architecture, trained on unlabeled data, is also capable of synthesizing high-quality speech from an intermediate feature representation. The task that we focus on in this paper is generating acoustic features given an input of linguistic features.

Various acoustic feature representations have been proposed for speech synthesis, including the mel-spectrogram \cite{shen2018natural}, which is a compressed version of the linear-spectrogram. However, for the singing voice, a good option is to use vocoder features, as they separate pitch from timbre of the signal. This is ideal for the singing voice as the pitch range of the voice while singing is much higher than that while speaking normally. Modelling the timbre independently of the pitch has been shown to be an effective methodology \cite{blaauw2017neural}. We note that the use of a vocoder for direct synthesis can lead to a degradation of sound quality, but this degradation can be mitigated by the use of a WaveNet vocoder trained to synthesize the waveform from the parametric vocoder features. As such, for the scope of this study, we limit the upper-bound of the performance of the model to that of the vocoder.

Like autoregressive networks, Generative adversarial networks (GANs) \cite{goodfellow2014generative,mirza2014conditional,salimans2016improved} are a family of generative frameworks for deep learning, which includes the Wasserstein-GAN \cite{arjovsky2017wasserstein} variant. While the methodology has provided exceptional results in fields related to computer vision, it has only a few adaptations in the audio domain and indeed in TTS, that we discuss in the following sections. We adapt the Wasserstein-GAN model for singing voice synthesis. In this paper, we present a novel block-wise generative model for singing voice synthesis, trained using the Wasserstein-GAN framework\footnote{The code for this model in the TensorFlow framework is available at \mbox{\footurl}. Audio examples, including synthesis with voice change and without the reconstruction loss can be heard at \mbox{\url{https://pc2752.github.io/sing_synth_examples/}}}. The block-wise nature of the model allows us to model temporal dependencies among features, much like the inter-pixel dependencies are modelled by the GAN architecture in image generation. For this study, we use the original fundamental frequency for synthesis, leading to a performance driven synthesis. As a result, we only model the timbre of the singing voice and not the expression via the $f0$ curve or the timing deviations of the singers.

The rest of the paper is organized as follows. Section \ref{sec:GANs} provides a brief overview of the GAN and Wasserstein-GAN generative frameworks. Section \ref{sec:related} discusses the state-of-the-art singing voice synthesis model that we use as a baseline in this paper and some of the recent applications of GANs in the field of TTS and in general, in the audio domain. The following sections, section \ref{sec:system} and section \ref{sec:feats} present our model for singing voice synthesis, followed by a brief discussion on the dataset used and the hyperparameters of the model in sections \ref{sec:data} and \ref{sec:hyper} respectively. We then present an evaluation of the  model, compared to the baseline in section \ref{sec:results}, before wrapping up with the conclusions of the paper and a discussion of our future direction in section \ref{sec:conclusion}.

\section{GANs And Wasserstein-GANs}
\label{sec:GANs}
Generative Adversarial Networks (GANs) have been extensively used for various applications in computer vision since their introduction. GANs can be viewed as a network optimization methodology based on a two-player non-cooperative training that tries to minimize the divergence between a parameterized generated distribution $P_g$ and a real data distribution, $P_r$. It consists of two networks, a generator, $G$ and a discriminator, $D$, which are trained simultaneously. The discriminator is trained to distinguish between a real input and a synthetic input output by the generator, while the generator is trained to fool the discriminator. The loss function for the network is shown in equation \ref{eq:GAN}.

\begin{equation}
\begin{aligned}[b]
\mathcal{L}_{GAN} =  \min\limits_{G}\max\limits_{D} \mathbb{E}_{y\sim P_r} [\log(D(y))]\\ + \mathbb{E}_{x\sim P_x} [\log(1-D(G(x)))]
\end{aligned}
\label{eq:GAN}
\end{equation}
Where $y$ is a sample from the real distribution and $x$ is the input to the generator, which may be noise or conditioning as in the Conditional GAN \cite{mirza2014conditional} and is taken from a distribution of such inputs, $P_x$.

While GANs have been shown to produce realistic images, there are difficulties in training including vanishing gradient, mode collapse and instability. To mitigate these difficulties, the Wasserstein-GAN \cite{arjovsky2017wasserstein} has been proposed, which optimizes an efficient approximation of the Earth-Mover (EM) distance between the generated and real distributions and has been shown to produce realistic images. The loss function for the WGAN is shown in equation \ref{eq:WGAN}. In this version of the GAN, the discriminator network is replaced by a network termed as critic, also represented by $D$, which can be trained to optimality and does not saturate, converging to a linear function.

\begin{equation}
\mathcal{L}_{WGAN} = \min\limits_{G}\max\limits_{D} \mathbb{E}_{y\sim P_r} [D(y)] - \mathbb{E}_{x\sim P_x} [D(G(x))]
\label{eq:WGAN}
\end{equation}

We use a conditional version of the model, which generates a distribution, parametrized by the network and conditioned on a conditional vector, described in section \ref{sec:feats} and follow the training algorithm proposed in the original paper \cite{arjovsky2017wasserstein}, with the same hyperparameters for training.

\section{Related Work}
\label{sec:related}

GANs have been adapted for TTS in several variations over recent years. The work closest to ours was the one proposed by Zhao et al. \cite{zhao2018wasserstein}, which uses a Wasserstein-GAN framework, followed by a WaveNet vocoder and a complimentary waveform based loss. Yang et al.  \cite{yang2017statistical} use the mean squared error (MSE) and a variational autoencoder (VAE) to enable the GAN optimization process in a multi-task learning framework. A BLSTM based GAN framework complemented with a style and reconstruction loss is used by Zhao et al. \cite{ma2018a}. While these models use recurrent networks for frame-wise sequential prediction, we propose a convolutional network based system to directly predict a block of vocoder features, based on an input conditioning of the same size in the time dimension.

Other examples of the application of GANs for speech synthesis include work done by Kaneko et al., \cite{kaneko2017generative} and  \cite{kaneko2017generative1}, which use GANs as a post-filter for acoustic models to overcome the oversmoothing related to the models used.
GANs have also been adapted to synthesize waveforms directly; WaveGAN \cite{donahue2018adversarial} is an example of the use of GANs to synthesize spoken instances of numerical digits, as well as other audio examples. GANSynth \cite{engel2018gansynth} has also been proposed to synthesize high quality musical audio using GANs.

For singing voice synthesis, Hono et al. \cite{hono2019singing} use a GAN-based architecture to model frame-wise vocoder features. This models the inter-feature dependencies within a frame of the output. In contrast, our model directly models a block of consecutive audio frames via the Wasserstein-GAN framework. This allows us to model temporal dependencies between features within that block. This temporal dependence is modelled via autoregression in the Neural Parametric Singing Synthesizer (NPSS) \cite{blaauw2017neural} model, which we use as a baseline in our study.

The NPSS uses an autoregressive architecture, inspired by the WaveNet \cite{oord2016wavenet}, to make frame-wise predictions of vocoder features, using a mixture density output. The network models the frame-wise distribution as a sum of Gaussians, the parameters of which are estimated by the network. In contrast, the use of adversarial networks for estimation, imposes no explicit constraints on the output distribution. The NPSS model has been shown to generate high quality singing voice synthesis, comparable or exceeding state-of-the-art concatenative methods. A multi-singer variation of the NPSS model has also been proposed recently \cite{blaauw2019data}, and is used as the baseline for our study.

\begin{figure}[H]
\centering
\includegraphics[width=\linewidth]{flow.pdf}
 \caption{The framework for the proposed model. A conditioning vector, consisting of frame-wise phoneme and $f0$ annotations along with speaker identity is passed to the generator. The critic is trained to distinguish between the generated sample and a real sample.}
 \label{fig:framework}
\end{figure}
\section{Proposed System}
\label{sec:system}

We adopt an architecture similar to the DCGAN \cite{radford2015unsupervised}, which was used for the original WGAN. For the generator, we use an encoder-decoder schema, shown in figure \ref{fig:generator} wherein both the encoder and decoder consist of $5$ convolutional layers with filter size $3$. Connections between the corresponding layers of the encoder and decoder, as in the U-Net \cite{ronneberger2015u} architecture are also implemented.
\begin{figure}[H]
\centering
\includegraphics[width=\linewidth]{gen.pdf}
 \caption{The architecture for the generator of the proposed network. The generator consists of an encoder and a decoder, based on the U-Net architecture \cite{ronneberger2015u}.}
 \label{fig:generator}
\end{figure}

While convolutional networks are capable of modelling arbitrary length sequences, the critic in our model takes a block of a fixed length input, thereby modelling the dependencies within the block. Furthermore, the encoder-decoder schema leads to conditional dependence between the features of the generator output, within the predicted block of features. This approach implies implicit dependence between vocoder features of a single block but not within the blocks themselves. As a result, for inference, we use overlap-add of consecutive blocks of output vocoder features, as shown in figure \ref{fig:overlap}. An overlap of $50\%$ was used with a triangular window across features. This appraoch is similar to that used by Chandna et al. \cite{chandna2017monoaural}
\begin{figure}[H]
\includegraphics[width=0.45\textwidth]{overlap.pdf}
 \caption{The overlap add process for the generated features. As shown, predicted features from time $t$ to time $t+N$ are overlap-added with features from time $t+N/2$ to $t+3N/2$, where $t$ is the start time of the process in view. A triangular window is used for the adding process, applied across each of the features.}
 \label{fig:overlap}
\end{figure}
As proposed by Radford et al. \cite{radford2015unsupervised}, we use strided convolutions in the encoder instead of deterministic pooling functions for downsampling. For the decoder, we use linear interpolation followed by normal convolution for upsampling instead of transposed convolutions, as this has been shown to avoid the high frequency artifacts which can be introduced by the latter \cite{stoller2018wave}. Blocks of size $N$ consecutive frames are passed as input to the network and the output has the same size.
Like the DCGAN, we use ReLU activations for all layers in the generator, except the final layer, which uses a tanh activation. We found that the use of batch normalization did not affect the performance much. We also found it helpful to guide the WGAN training by adding a reconstruction loss, as shown in equations \ref{eq:L1} and \ref{eq:WL1}. This reconstruction loss is often used in conditional image generation models like Lee et al.\cite{lee2018harmonizing}.
\begin{gather}
\mathcal{L}_{recon} = \min\limits_{G}\mathbb{E}_{x,y} \left\lVert G(x)-y\right\rVert
\label{eq:L1}\\
 \mathcal{L}_{total} = \mathcal{L}_{WGAN} + \lambda_{recon} \mathcal{L}_{recon}
\label{eq:WL1}
\end{gather}
Where $\lambda_{recon}$ is the weight given to the reconstruction loss. The networks are optimized following the scheme described in Arjovsky et al.\cite{arjovsky2017wasserstein}.
The critic for our system uses an architecture similar to the encoder part of the generator, but uses LeakyReLU activation instead of ReLU, as used by Radford et al. \cite{radford2015unsupervised}.

Convolutional neural networks offer translation invariance across the dimensions convolved, making them highly useful in image modelling. However, for audio signals, this invariance is useful only across the time-dimension but undesirable across the frequency dimension. As such, we follow the approach of NPSS \cite{blaauw2017neural}, representing the features as a 1D signal with multiple channels.

\section{Linguistic And Vocoder Features}
\label{sec:feats}
The input conditioning to our system consists of frame-wise phoneme annotations, represented as a one-hot vector and continuous fundamental frequency extracted by the spectral autocorrelation (SAC) algorithm. This conditioning is similar to the one used in NPSS. In addition, we condition the system on the singer identity, as a one-hot vector, broadcast throughout the time dimension. This approach is similar to that used in the WaveNet \cite{oord2016wavenet}. The three conditioning vectors are then passed through a $1\times1$ convolution and concatenated together along with noise sampled from a uniform distribution and passed to the generator as input.

We use the WORLD vocoder \cite{morise2016world} for acoustic modelling of the singing voice. The system decomposes a speech signal into the harmonic spectral envelope and aperiodicity envelope, based on the fundamental frequency $f0$. We apply dimensionality reduction to the vocoder features, similar to that used in \cite{blaauw2017neural}.

\section{Dataset}
\label{sec:data}
We use the NUS-48E corpus \cite{duan2013nus}, which consists of $48$ popular English songs, sung by $12$ male and female singers. The singers are all non-professional and non-native English speakers. Each singer sings $4$ different songs from a set of $20$ songs, leading to a total of \SI{169}{\minute} of recordings, with \num{25474} phoneme annotations. We train the system using all but $2$ of the song instances, which are used for evaluation.

\section{Hyperparameters}
\label{sec:hyper}
A hoptime of \SI{5}{\milli\second} was used for extracting the vocoder features and the conditioning. We tried different block-sizes, but empirically found that $N=128$ frames, corresponding to \SI{640}{\milli\second} produced the best results.

We used a weight of $\lambda_{recon} = 0.0005$ for $\mathcal{L}_{recon}$ and trained the network for \num{3000} epochs. As suggested in \cite{arjovsky2017wasserstein}, we used RMSProp for network optimization, with a learning rate of $0.0001$.
After dimension reduction, we used \num{60} harmonic and \num{4} aperiodic features per frame, leading to a total of \num{64} vocoder features.

\section{Evaluation Methodology}
For objective evaluation, we use the Mel-Cepstral Distortion metric. This metric is presented in table \ref{table:mcd}.
For subjective evaluation, we used an online AB test wherein the participants were asked to choose between two presented \SIrange{5}{7}{\second} examples\footnote{We found that WGANSing without the reconstruction loss as a guide did not produce very pleasant results and did not include this in the evaluation. However, examples for the same can be heard at \mbox{\url{https://pc2752.github.io/sing_synth_examples/}}}, representing phrases from the songs. The participant's choice was based on the criteria of Intelligibility and Audio Quality. We compare our system to the NPSS, trained on the same dataset. Along with the NPSS, we use a re-synthesis with the WORLD vocoder as the baseline as this is the upper limit of the performance of our system. We compared $3$ pairs for this evaluation:
\begin{itemize}
    \item WGANSing - Original song re-synthesized with WORLD vocoder.
    \item WGANSing - NPSS
    \item WGANSing, original singer - WGANSing, sample with different singer.

\end{itemize}

\begin{figure}[H]

\includegraphics[width=\linewidth]{gan_NPSS.pdf}
 \caption{Subjective test results for the WGANSing-NPSS pair.}
 \label{fig:ganpss}
\end{figure}

For the synthesis with a changed singer, we included samples with both singers of the same gender as the original singer and of a different gender. The input $f0$ to the system was adjusted by an octave to account for the different ranges of the genders. For each criteria, the participants were presented with $5$ questions for each of the pairs, leading to a total of $15$ questions per criteria and $30$ questions overall\footnote{The subjective listening test used in our study can be found at \mbox{\url{https://trompa-mtg.upf.edu/synth_eval/}}}.

\section{Results}
\label{sec:results}

There were a total of $27$ participants from over $10$ nationalities, including native English speaking countries like the USA and England, and ages ranging from $18$ to $37$ in our study. The results of the tests are shown in figures \ref{fig:ganori}, \ref{fig:ganpss} and \ref{fig:gancha}.

\begin{figure}[H]

\includegraphics[width=\linewidth]{gan_ori.pdf}
 \caption{Subjective test results for the WGANSing-Original pair.}
 \label{fig:ganori}
\end{figure}

From the first two figures, it can be seen that our model is qualitatively competitive with regards to both the original baseline and the NPSS, even though a preference is observed for the later. This result is supported by the objective measures, seen in table \ref{table:mcd}, which show parity between WGANSing and the NPSS models. Figure \ref{fig:gancha} shows that the perceived intelligibility of the audio is preserved even after speaker change, even though there is a slight compromise on the audio quality.
\begin{figure}[H]
\includegraphics[width=\linewidth]{gan_cha.pdf}
 \caption{Subjective test results for the WGANSing-WGANSing Voice Change pair.}
 \label{fig:gancha}
\end{figure}
Variability in the observed results can be attributed to the subjective nature of the listening test, the diversity of participants and the dataset used, which comprises of non-native, non-professional singers. We note that there is room for improvement in the quality of the system, as discussed in next section.
\begin{table}[H]\centering
\begin{tabular}{@{}llll@{}}
\toprule
Song           & WGAN + $\mathcal{L}_{recon}$   & WGAN        & NPSS        \\
\midrule
Song 1 JLEE 05 & 5.36 dB & 9.70 dB & 5.62 dB \\
Song 2 MCUR 04 & 5.40 dB & 9.63 dB & 5.79 dB \\
\bottomrule
\end{tabular}

\caption{The MCD metric for the two songs used for validation of the model. The three models compared are the NPSS\cite{blaauw2017neural} and the WGANsing model with and without the reconstruction loss.}
\label{table:mcd}
\end{table}

\section{Conclusions And Discussion}
\label{sec:conclusion}
We have presented a multi-singer singing voice synthesizer based on a block-wise prediction topology. This block-wise methodology, inspired by the work done in image generation allows the framework to model inter-block feature dependency, while long-term dependencies are handled via an overlap-add procedure. We believe that synthesis quality can further be improved by adding the previously predicted block of features as a further conditioning to current batch of features to be predicted. Further contextual conditioning, such as phoneme duration, which is currently implicitly modelled, can also be added to improve synthesis. Synthesis quality can also be improved through post-processing techniques such as the use of the WaveNet vocoder on the generated features.

We also note that the synthesis was greatly helped by the addition of the reconstruction loss, while the use of batch normalization did not affect performance either way. The synthesis quality of the model was evaluated to be comparable to that of stat-of-the-art synthesis systems, however, we note that variability in subjective measures like intelligibility and quality is introduced during the listening test, owing to the diversity of the population participating. This variability can be reduced through a targeted listening test with expert participants. The generative methodology used allows for potential exploration in expressive singing synthesis. Furthermore, the fully convolutional nature of the model leads to faster inference than autoregressive or recurrent network based models.

\section*{acknowledgments}
This work is partially supported by the European Commission under the TROMPA project (H2020 770376). The TITAN X used for this research was donated by the NVIDIA Corporation.
\vspace{12pt}
\bibliographystyle{IEEEtran}

Sound (cs.SD); Audio and Speech Processing (eess.AS)


Magnetic fields of AGB and post-AGB stars

Abstract: There is ample evidence for strong magnetic fields in the envelopes of (Post-)Asymptotic Giant Branch (AGB) stars as well as supergiant stars. The origin and role of these fields are still unclear. This paper updates the current status of magnetic field observations around AGB, post-AGB stars and describes their possible role during these stages of evolution. The discovery of magnetically aligned dust around a supergiant star is also highlighted. In our search for the origin of the magnetic fields, recent observations show the signatures of possible magnetic activity and rotation, indicating that the magnetic fields might be intrinsic to the AGB stars.

\section{Introduction}

Magnetic fields are ubiquitous throughout the Universe and play an
important role across a wide range of scales. Primordial magnetic
fields could have played a role in the formation of the first stars
just as magnetic fields in molecular clouds are an important
ingredient in current star formation. Magnetic fields have also been
detected in almost all stellar types and in almost all phases of
stellar evolution (e.g. Berdyugina 2009), and have significant effects
on stellar evolution through, e.g. their influence on the internal
mixing.  The magnetic field of stars can have either a dynamo origin,
i.e. be generated by a dynamo process in the star itself
(e.g. Charbonneau 2014), or can be the result of a remnant 'fossil'
field, which are fields that originate from the star formation process
(e.g. Braithwaite \& Spruit 2004). The stellar magnetic field is
affected by the changes of physical properties during stellar
evolution and, because of flux conservation, becomes increasingly
difficult to observe at the stellar surface when the star expands in
the final phases of its life. However, in stellar end products, such
as white dwarfs and neutron stars, magnetic fields are also shown to
be significant.

The role of magnetic fields around AGB stars is not clear. In
principle, they could help levitate material off the stellar surface
through Alfv{'e}n waves (e.g. Falceta-Gon{\c c}alves \& Jatenco-Pereira
2002), or through the creation of cool spots on the surface above with
dust can form easier (Soker 1998). A specific model for the AGB star o
Ceti (Mira A) has shown that a hybrid magnetohydrodynamic-dust-driven
wind scenario can explain its mass loss (Thirumalai \& Heyl 2013). In
such a model, Alfv{\'e}n waves add energy to lift material before dust
forms and radiation pressure accelerates a wind. Magnetic fields also
play an important role in the internal mixing required for s-process
(slow) neutron capture reactions that define the stellar yields
(e.g. Trippella et al. 2016).

After the AGB phase, the stellar envelopes undergo a major
modification as they evolve to Planetary Nebulae (PNe). The standard
assumption is that the initial slow AGB mass loss quickly changes into
a fast superwind, generating shocks and accelerating the surrounding
envelope (Kwok et al. 1978). It is during this phase that the
typically spherical CSE evolves into a Planetary Nebula. As the
majority of of pre-PNe are aspherical, an additional mechanism is
needed to explain the departure from sphericity. This mechanism is
still a matter of fierce debate. One possibility is that the
interaction of the post-AGB star and a binary companion or massive
planet supports a strong magnetic field that is capable of shaping the
outflow (e.g. Nordhaus et al. 2007).

This paper expands on (and partly reproduces) the reviews presented in
\cite[Vlemmings 2018]{Vlemmings18a} and \cite[Vlemmings
2014]{Vlemmings14} and I refer interested readers to
those review (and references therein) for further background.

\section{Overview of magnetic field observations}

\begin{figure}
\begin{center}
\includegraphics[width=10cm]{Vlemmings_IAUS343_fig1.pdf}
\caption{The circumstellar magnetic field strength vs. radius relation as indicated by current (maser)
polarization observation. The boxes show
the range of observed magnetic field strengths derived from the
observations of SiO masers (\cite[Kemball et
al. 2009]{Kemball2009}, \cite[Herpin et al. 2006]{Herpin2006}), H$_2$O masers
(\cite[Vlemmings et al. 2002]{Vlemmings2002},\cite[Vlemmings et
al. 2005]{Vlemmings2005}, \cite[Leal-Ferreira et al. 2013]{Ferreira2013}), OH masers
(\cite[Rudnitski et al. 2010]{Rudnitski2010}, \cite[Gonidakis et
al. 2014]{Gonidakis2014}) and CN (\cite[Duthu et al. 2017]{Duthu2017}). The thick solid
and dashed lines indicate an $r^{-2}$ solar-type and $r^{-1}$
toroidal magnetic field configuration. The vertical dashed line
indicates the stellar surface. Observations of the Goldreich-Kylafis
effect in CO (\cite[e.g. Vlemmings et al. 2012]{Vlemmings2012}) will
uniquely probe the outer edge of the envelope (vertical dashed dotted
line).}
\label{fig1}
\end{center}
\end{figure}

\subsection{AGB stars}

Generally, AGB magnetic field measurements come from maser
polarization observations (SiO, H$_2$O and OH). These have revealed a
strong magnetic field throughout the circumstellar
envelope. Figure~\ref{fig1}, the magnetic field strength in the
regions of the envelope traced by the maser measurements throughout
AGB envelopes. The field appears to vary between $B\propto R^{-2}$
(solar-type) and $B\propto R^{-1}$ (toroidal). Although the maser
observations trace only oxygen-rich AGB stars, recent CN Zeeman
splitting observations (\cite[Duthu et al. 2017]{Duthu2017}) indicate
that similar strength fields are found around carbon-rich stars. The
envelope magnetic fields are also consistent with thus far the only
direct measurement of the Zeeman effect on the surface of an AGB star,
the Mira variable star $\chi$~Cyg (\cite[L{\`e}bre et
al. 2014]{Lebre2014}).  In Table.~1 an overview is given of the energy
densities throughout the AGB envelopes.

The large-scale structure of the magnetic field is more difficult to
infer, predominantly because the maser observations often probe only
limited line-of-sights. Even though specifically OH observations seem
to indicate a systematic field structure, it has often been suggested
that there might not be a large-scale component to the field that
would be necessary to shape the outflow (Soker 2002). Until recently
the only tight shape constraints throughout the envelope had been
determined for the field around the supergiant star VX Sgr, where
maser observations spanning 3 orders of magnitude in distance are all
consistent with a large scale, possibly dipole shaped, magnetic field
(Vlemmings et al. 2005, Vlemmings et al. 2011).

Very recent ALMA observations have shown that it will soon be possible
to finally overcome the problems with determining the circumstellar
magnetic field structure. This involves observations aimed at
measuring the Goldreich-Kylafis effect, which allows us to use the
polarisation of non-maser molecular lines (in this case CO) to
determine the magnetic field morphology in the more diffuse
circumstellar gas. The first of these observations, for the post-AGB
star OH~17.7-2.0, indicate that the magnetic field structure probed by
the CO is consistent with that derived from OH maser observations
(Fig.~\ref{OH17}, Tafoya \& Vlemmings in prep.). This puts to rest the
decades old question if maser magnetic field measurements can really
be used to probe the large-scale fields. The second set of
observations has given us the first view velocity resolved view of
the large-scale magnetic field in the AGB stars IRC+10216
(Fig.~\ref{IRC}, Vlemmings et al. in prep.).

\begin{figure}
\centering
\includegraphics[width=13.5cm]{Vlemmings_IAUS343_fig2.pdf}
\caption{A comparison of the magnetic field determined using ALMA
  observations of the Goldreich-Kylafis effect on circumstellar CO
  (left, Tafoya \& Vlemmings, in prep.) and MERLIN observations of OH masers (right, Bains et al. 2003) around the post-AGB star OH 17.7-2.0. These observations show that the CO and OH trace the same large-scale magnetic field.}
 \label{OH17}
\end{figure}

\begin{figure}
\centering
\includegraphics[width=13.5cm]{Vlemmings_IAUS343_fig3.pdf}
\caption{Four channel maps showing the Goldreich-Kylafis effect on the
  CO(3-2) line in the envelope of the AGB star IRC+10216. The ALMA
  observations for the first time clearly resolve the magnetic field
  structure throughout the CSE. The red vectors indicate the
  polarisation direction. The linearly polarised emission is shown in
  greyscale. The contours indicate the total intensity emission. A
  structure function analysis will be able to reveal the velocity
  resolved field strength and initial indication indicate a structured
  field with a strength $>1$~G at the stellar surface(Vlemmings et al., in prep.).}
 \label{IRC}
\end{figure}

\subsection{post-AGB stars}

Similar to the AGB stars, masers are the main source of magnetic field
information of post-AGB and P-PNe and even for some PNe. OH maser
observations indicate magnetic field strengths similar to those of AGB
stars (few mG) and a clear large scale magnetic field structure
(\cite[Bains et al. 2003]{Bains2003}, \cite[G{\'o}mez et
al. 2016]{Gomez2016}). Also dust polarization observations indicate a
large scale magnetic field (\cite[e.g. Sabin et
al. 2015]{Sabin2015b}).

Magnetic fields have also been detected around the so-called
'water-fountain' sources. These sources exhibit fast and highly
collimated H$_2$O maser jets that often extend beyond even the regular
OH maser shell. With the dynamical age of the jet of order 100 years,
they potentially are the progenitors of the bipolar
(P-)PNe. Observations of the arch-type of the water-fountains, W43A,
have revealed a strong toroidal magnetic field that is collimating the
jet (\cite[Vlemmings et al. 2006]{Vlemmings2006}). For another water-fountain source,
IRAS~15445-5449, a synchrotron jet related to strong magnetic fields
has been detected (\cite[P{\'e}rez-S{\'a}nchez et al. 2013]{PerezSanchez2013a}). Similar, synchrotron
emission has been found from what could be one of the youngest PNe
(\cite[Su{\'a}rez et al. 2015]{Suarez2015}).

Finally, recently also surface fields have been measured for 2
post-AGB stars (\cite[Sabin et al. 2015]{Sabin2015a}). These fields are consistent with
the fields inferred from the envelope measurements

\begin{center}
\begin{table}
\caption{Energy densities in AGB envelopes}
\begin{tabular}{ l l || c | c | c | c | c }
\hline
 & & Photosphere & SiO & H$_2$O & OH & CO/CN \\
\hline
 & & & & & & \\
 $B$ & [G] & $\sim1-10$? & $\sim3.5$ & $\sim0.3$ & $\sim0.003$ & $\sim0.003-0.008$\\
 $R$ & [AU] & - & $\sim3$ & $\sim25$ & $\sim50$ & $\sim50-100$ \\
$V_{\rm exp}$ & [km~s$^{-1}$] & $\sim20$ & $~\sim5$ & $\sim8$ &
$\sim10$ & $\sim10$ \\
 $n_{\rm H_2}$ & [cm$^{-3}$] & $\sim10^{11}$ & $\sim10^{10}$&
 $\sim10^{8}$ & $\sim10^{6}$ & $\sim10^{5}$ \\
 $T$ & [K] & $\sim2500$ & $\sim1300$ & $\sim500$ & $\sim300$ & $\sim150$\\
 & & & & & \\
\hline
 & & & & & \\
 $B^2/8\pi$ & [dyne~cm$^{-2}$] & $\mathbf{10^{-1.4,+0.6}}$ &
 $\mathbf{10^{+0.1}}$ & $\mathbf{10^{-2.4}}$ & $10^{-6.4}$ & $\mathbf{10^{-6.0,-6.4}}$\\
 $nKT$ & [dyne~cm$^{-2}$] & $10^{-1.5}$ & $10^{-2.7}$ & $10^{-5.2}$ &
 $10^{-7.4}$ &  $10^{-8.7}$\\
 $\rho V_{\rm exp}^2$ & [dyne~cm$^{-2}$] & $10^{-0.3}$ & $10^{-2.5}$ &
 $10^{-4.1}$ & $\mathbf{10^{-5.9}}$ & $10^{-6.9}$ \\
 $V_A$ & [km~s$^{-1}$] & $\sim20$ & $\sim100$ & $\sim300$ & $\sim8$&
 $\sim8$ \\
 & & & & & \\
\hline
\end{tabular}
\label{energy}
\caption{Energy densities through AGB star envelopes. From left to
  right the columns indicate the stellar photosphere, maser regions
  and the region probed by CO/CN, with increasing distance to the
  central star. The top rows are the typical magnetic field strength
  $B$, distance to the star $R$, expansion velocity $V_{\rm exp}$,
  hydrogen number density $n_{\rm H}$ and temperature $T$. The bottom
  rows are the magnetic, thermal and kinematic energy and a rough
  estimate of the Alvf{\'e}n velocity $V_A$.}
\end{table}
\end{center}

\subsection{Supergiant stars}

Many maser observations show that strong magnetic fields are also
present in the envelopes of Red Supergiant stars (\cite[e.g. Vlemmings
et al. 2002, Herpin et al. 2006]{Vlemmings2002, Herpin2006}). The
questions about local or large scale fields, are the same as around
AGB stars. As noted above, the supergiant VX~Sgr is one of the first
stars where a large scale magnetic field, with a structure consistent
throughout the envelope, was found. At (sub-)millimeter wavelengths it
is now possible to simultaneously study the polarization of masers,
regular molecular lines, and circumstellar dust using ALMA. Recent observations
of VY~CMa indicate magnetically aligned dust and consistent structures
between the maser and non-maser molecular lines (\cite[Fig.~\ref{VY},
Vlemmings et al. 2017]{Vlemmings2017a}). The observations indicate that
magnetic fields could be involved in the mass loss of these massive
stars.

 \begin{figure*}
 \centering
 \includegraphics[width=12cm]{Vlemmings_IAUS343_fig4.pdf}
 \caption{ALMA observations of the dust around the RSG VY~CMa at
   178~GHz (\cite[Vlemmings et al. 2017]{Vlemmings2017a}). Arrows
   indicate a strong dust clump (C)
   and the star (VY). The grey scale image
   is the linearly polarized intensity. The similarly spaced red contours
   (left) indicate the ALMA 658~GHz continuum from \cite[O'Gorman et
   al. 2015]{OGorman2015}. The vectors
   (right) indicate the direction of the magnetic field traced by
   magnetically aligned dust grains.}
       \label{VY}
 \end{figure*}

\begin{figure}
\begin{center}
\includegraphics[width=13.5cm]{Vlemmings_IAUS343_fig5.pdf}
\caption{Brightness temperature map of the AGB star W~Hya observed
  with ALMA at 338 GHz (\cite[Vlemmings et al. 2017]{Vlemmings2017}). The red ellipse indicates
the size of the stellar disk at 338~GHz while the white circles
indicates the size of the optical photosphere. The clear hotspot is
unresolved and it brightness temperature in the map is a lower
limit. From size measurements we can constrain the true brightness
temperature to be $>50.000$~K, which could be a sign of shock
interaction or magnetic activity.}
\label{fig2}
\end{center}
\end{figure}

\section{Indirect tracers and origin of the magnetic field}

The origin of AGB magnetic fields is unclear and might require an
extra source of angular momentum to maintain a stellar dynamo. This
however depends strongly on the magnetic coupling throughout the star
itself. If a sufficiently strong magnetic field persist at the AGB
stellar surface, it might be possible to detect signs of magnetic
activity. Recently, it has been shown that the majority of the AGB
stars are UV-emitters (\cite[Montez et al. 2017]{Montez17}) which could
be a sign of (magnetic) activity. Similarly, recent observation of the
surface of the AGB star W Hya show high brightness temperature
hotspots (\cite[Fig~\ref{fig2}, Vlemmings et
al. 2017]{Vlemmings2017}). These spots can arise from strong shocks
but could also point to magnetic activity.

\begin{figure}
\centering
\includegraphics[width=13.5cm]{Vlemmings_IAUS343_fig6.pdf}
\caption{From \cite[Vlemmings et al. 2018]{Vlemmings18b} {\it (left)}: Center velocity of the SiO $v=3, J=5-4$
emission line indicating the fast rotation in the envelope of R~Dot. The red ellipse indicates the measured size of
the star at $214$~GHz. {\it (right)}: The best fit model of
solid-body rotation including a small expansion velocity component.}
 \label{SiOfit}
\end{figure}

As previously noted, the angular momentum imparted by a stellar (or
sub-stellar) companion might be needed to maintain a stellar dynamo
that can generate the observed magnetic fields. However, rotation is
very difficult to measure for the extended AGB stars that are
undergoing pulsations and show large convective cells. Only very
recently has ALMA been able to measure the fast ($\sim1$~km~s$^{-1}$)
rotation of the AGB star R~Dor  (\cite[Fig~\ref{SiOfit}, Vlemmings et
al. 2018]{Vlemmings2018}). As the rotation is almost two orders
of magnitude larger than otherwise expected, it is a likely sign of
interaction with an hitherto unknown companion. Unfortunately, no
magnetic field observations exist yet for R~Dor and it it is thus not
yet possible to establish a link between the generation of a magnetic
field and the fast rotation.

\section{Conclusions}

Magnetic fields are ubiquitous around AGB and post-AGB stars, and
several observations indicate a link between the magnetic field and
the collimated outflows found in pre-PNe. Additionally, indirect
observations of hotspots and UV-emission might point to magnetic
activity on the surface of AGB stars. However, it is only now possible
to start probing the morphology of the magnetic field in AGB envelopes
and to finally determine the role of magnetism around evolved stars.

Solar and Stellar Astrophysics (astro-ph.SR)


On the Relationships Between the Grammatical Genders of Inanimate Nouns and Their Co-Occurring Adjectives and Verbs

Abstract: We use large-scale corpora in six different gendered languages, along with tools from NLP and information theory, to test whether there is a relationship between the grammatical genders of inanimate nouns and the adjectives used to describe those nouns. For all six languages, we find that there is a statistically significant relationship. We also find that there are statistically significant relationships between the grammatical genders of inanimate nouns and the verbs that take those nouns as direct objects, as indirect objects, and as subjects. We defer a deeper investigation of these relationships for future work.

\section{Introduction}
In many languages, nouns possess grammatical genders. When a noun
refers to an animate object, its grammatical gender typically reflects
the biological sex or gender identity of that object
\citep{zubin1986,corbett1991gender,kramer2014}.\blfootnote{$^{\emoji[twitter]{1F32A}}$equal contribution in this scientific whirlwind} For example, in
German, the word for a boss is grammatically feminine when it refers
to a woman, but grammatically masculine when it refers to a
man---\word{Chef\textbf{in}} and \word{Chef}, respectively. But
inanimate nouns (i.e., nouns that refer to inanimate objects) also
possess grammatical genders. Any German speaker will tell you that the
word for a bridge, \word{Br{\"u}cke}, is grammatically feminine, even
though bridges have neither biological sexes nor gender
identities. Historically, the grammatical genders of inanimate nouns
have been considered more idiosyncratic and less meaningful than the
grammatical genders of animate nouns \citep{brugmann1889,
  bloomfield1933language, fox1990, aikhenvald2000}. However, some
cognitive scientists have reopened this discussion by using laboratory
experiments to test whether speakers of gendered languages reveal
gender stereotypes \citep{sera1994}---for example, and
most famously, when choosing adjectives to describe inanimate nouns
\citep{boroditsky2003sex}.\looseness=-1

Although laboratory experiments are highly informative, they typically
involve small sample sizes. In this paper, we therefore use
large-scale corpora and tools from NLP and information theory to test
whether there is a relationship between the grammatical genders of
inanimate nouns and the adjectives used to describe those
nouns. Specifically, we calculate the mutual information (MI)---a
measure of the mutual statistical dependence between two random
variables---between the grammatical genders of inanimate nouns and the
adjectives that describe them (i.e., share a dependency arc labeled
\textsc{amod}) using large-scale corpora in six different gendered
languages (specifically, German, Italian, Polish, Portuguese, Russian,
and Spanish). For all six languages, we find that the MI is
statistically significant, meaning that there is a
relationship.\looseness=-1

We also test whether there are relationships between the grammatical
genders of inanimate nouns and the verbs that take those nouns as
direct objects, as indirect objects, and as subjects. For all six
languages, we find that there are statistically significant
relationships for the verbs that take those nouns as direct objects
and as subjects. For five of the six languages, we also find that
there is statistically significant relationship for the verbs that
take those nouns as indirect objects, but because of the small number
of noun--verb pairs involved, we caution against reading too much into
this finding.

To contextualize our findings, we test whether there are statistically
significant relationships between the grammatical genders of inanimate
nouns and the cases and numbers of these nouns. A priori, we do not
expect to find statistically significant relationships, so these tests
can be viewed as a baseline of sorts. As expected, for each of the six
languages, there are no statistically significant relationships.

To provide further context, we also repeat all tests for
\emph{animate} nouns---a ``skyline'' of sorts---finding that for all
six languages there is a statistically significant relationship
between the grammatical genders of animate nouns and the adjectives
used to describe those nouns. We also find that there are
statistically significant relationships between the grammatical
genders of animate nouns and the verbs that take those nouns as direct
objects, as indirect objects, and as subjects. All of these
relationships have effect sizes (operationalized as normalized MI
values) that are larger than the effect sizes for inanimate
nouns.\looseness=-1

We emphasize that the practical significance and implications of our
findings require a deeper investigation. Most importantly, we do not
investigate the characteristics of the relationships that we
find. This means that we do not know whether these relationships are
characterized by gender stereotypes, as argued by some cognitive
scientists. We also do not engage with the ways that historical and
sociopolitical factors affect the grammatical genders possessed by
either animate or inanimate nouns
\citep{fodor1959,ibrahim2014}.\looseness=-1

\section{Background}\label{sec:background}
\subsection{Grammatical Gender}\label{sec:grammatical-gender}

Languages lie along a continuum with respect to whether nouns possess
grammatical genders. Languages with no grammatical genders, like
Turkish, lie on one end of this continuum, while languages with tens
of gender-like classes, like Swahili \cite{corbett1991gender}, lie on
the other. In this paper, we focus on six\xspace different gendered languages
for which large-scale corpora are readily available: German, Italian,
Polish, Portuguese, Russian, and Spanish---all languages of
Indo-European descent. Three of these languages (Italian, Portuguese,
and Spanish) have two grammatical genders---masculine and
feminine---while the other two have three grammatical
genders---masculine, feminine, and neuter.\looseness=-1

All six languages exhibit gender agreement, meaning that words are
marked with morphological suffixes that reflect the grammatical genders
of their surrounding nouns \cite{corbett2006agreement}. For example,
consider the following translations of the sentence, \emph{``The
  delicate fork is on the cold ground.''}\looseness=-1
\exg. \textit{\textbf{Die}} \textit{zierlich\textbf{e}} \textit{Gabel}
\textit{steht} \textit{auf} \textit{\textbf{dem}}
\textit{kalt\textbf{en}}
\textit{\textbf{Boden}}.\\ the.\textsc{f}.\textsc{sg}.\textsc{nom}
delicate.\textsc{f}.\textsc{sg}.\textsc{nom}
fork.\textsc{f}.\textsc{sg}.\textsc{nom} stands on
the.\textsc{m}.\textsc{sg}.\textsc{dat}
cold.\textsc{m}.\textsc{sg}.\textsc{dat}
ground.\textsc{m}.\textsc{sg}.\textsc{dat}\\ {The delicate fork is on
  the cold ground.}

\exg. \textit{\textbf{El}} \textit{tenedor} \textit{delicad\textbf{o}}
\textit{est{\'a}} \emph{en} \emph{\textbf{el}} \emph{suel\textbf{o}}
\textit{fr\'i\textbf{o}}.\\ the.\textsc{m}.\textsc{sg}
fork.\textsc{m}.\textsc{sg} delicate.\textsc{m}.\textsc{sg} is on
the.\textsc{m}.\textsc{sg} ground.\textsc{m}.\textsc{sg}
cold.\textsc{m}.\textsc{sg}\\ {The delicate fork is on the cold
  ground.}

Because the German word for a fork, \word{Gabel}, is grammatically
feminine, the German translation uses the feminine determiner,
\word{die}. Had \word{Gabel} been masculine, the German translation
would have used the masculine determiner, \word{der}. Similarly,
because the Spanish word for a fork, \word{tenedor}, is grammatically
masculine, the Spanish translation uses the masculine determiner,
\word{el}, instead of the feminine determiner, \word{la}. As we
explain in Section \ref{sec:preparation}, we lemmatize each corpus to
ensure that our tests do not simply reflect the presence of gender
agreement.

\subsection{Grammatical Gender \& Meaning}

Although some scholars have described the grammatical genders
possessed by inanimate nouns as ``creative'' and meaningful
\citep{grimm1890, wheeler1899}, many scholars have considered them to
be idiosyncratic \citep{brugmann1889,bloomfield1933language} or
arbitrary \citep[317]{maratsos1979}. In an overview of this work,
\newcite{dye2017functional} wrote, ``As often as not, the languages of
the world assign [inanimate] objects into seemingly arbitrary
[classes]\textellipsis \citeauthor{ockham1980} considered gender to be
a meaningless, unnecessary aspect of language.''
\newcite{bloomfield1933language} shared this viewpoint, stating that
``[t]here seems to be no practical criterion by which the gender of a
noun in German, French, or Latin [can] be determined.''  Indeed, adult
language learners often have particular difficulty mastering the
grammatical genders of inanimate nouns
(\citealt[Ch.4]{franceschina2005},
\citealt{dekeyser2005,montrul2008}), which suggests that their
meanings are not straightforward.\looseness=-1

Even if the grammatical genders possessed by inanimate nouns are
meaningless, ample evidence suggests that gender-related information
may affect cognitive processes \citep{sera1994,cubelli2005,
  cubelli2011, kurinski2011, boutonnet2012, saalbach2012}. Typologists
and formal linguists have argued that grammatical genders are an
important feature for morphosyntactic processes
\citep{corbett1991gender,corbett2006agreement,harbour2008,harbour2011,kramer2014,kramer2015},
while some cognitive scientists have shown that grammatical genders
can be a perceptual cue---for example, human brain responses exhibit
sensitivity to gender mismatches in several different languages
\citep{osterhout1995,hagoort1999,vigliocco2002,
  wicha2003,wicha2004,barber2004,barber2005,banon2012,caffarra2015},
and the grammatical genders of determiners and adjectives can prime
nouns \citep{bates1996,akhutina1999,friederici1999}. However, the
precise nature of the relationship between grammatical gender and
meaning remains an open research question.\looseness=-1

In particular, the grammatical genders possessed by inanimate nouns
might affect the ways that speakers of gendered languages
conceptualize the objects referred to by those nouns
\citep{jakobson1959,clarke1981,ervin1962,konishi1993,sera1994,sera2002,
  vigliocco2005grammatical,bassetti2007}---although we note that this
viewpoint is somewhat contentious
\citep{hofstatter1963,bender2011,mcwhorter2014language}. Neo-Whorfian cognitive scientists
hold a particularly strong variant of this viewpoint, arguing that
that the grammatical genders possessed by inanimate nouns prompt
speakers of gendered languages to rely on gender stereotypes when
choosing adjectives to describe those nouns \citep{Boroditsky00sex,
  boroditsky2002can, phillips2003can, boroditsky2003,
  boroditsky2003sex, semenuks2017}.  Most famously,
\newcite{boroditsky2003sex} claim to have conducted a laboratory
experiment showing that speakers of German choose stereotypically
feminine adjectives to describe, for example, bridges, while speakers
of Spanish choose stereotypically masculine adjectives, reflecting the
fact that in German, the word for a bridge, \word{Br{\"u}cke}, is
grammatically feminine, while in Spanish, the word for a bridge,
\word{puente}, is grammatically masculine. \newcite{boroditsky2003sex}
took these findings to be a relatively strong confirmation of the
existence of a stereotype effect---i.e., that speakers of gendered
languages reveal gender stereotypes when choosing adjectives to
describe inanimate nouns. That said, the experiment has not gone
unchallenged. Indeed, \newcite{mickan2014key} reported two
unsuccessful replication attempts. \looseness=-1

\subsection{Laboratory Experiments vs. Corpora}\label{sec:neo-whorphianism-gender-embeddings}

Traditionally, studies of grammatical gender and meaning have relied
on laboratory experiments. This is for two reasons: 1) laboratory
experiments can be tightly controlled, and 2) they enable scholars to
measure speakers' immediate, real-time speech production. However,
they also typically involve small sample sizes and, in many cases,
somewhat artificial settings. In contrast, large-scale corpora of
written text enable scholars to measure even relatively weak
correlations via writers' text production in natural, albeit less
tightly controlled, settings. They also facilitate the discovery of
correlations that hold across languages with disparate histories,
cultural contexts, and even gender systems. As a result, large-scale
corpora have proven useful for studying a wide variety of
language-related phenomena
\citep[e.g.,][]{featherston2007,kennedy2014,
  blasi2019distribution}.\looseness=-1

\begin{figure*}
\centering
\begin{dependency}
\begin{deptext}[column sep=1em, row sep=.1ex]
$[\textsc{pron};\textsc{1};\textsc{sg}]$ \&
$[\textsc{v};\textsc{1};\textsc{sg}]$ \&
$[\textsc{v};\textsc{inf}]$ \&
$[\textsc{d};\textsc{msc};\textsc{sg}]$ \&
$[\textsc{n};\textsc{msc};\textsc{sg}]$ \&
$[\textsc{a};\textsc{msc};\textsc{sg}]$ \\
\it yo \& \it quier-o \& \it cruz-ar \& \it un \& \it puente \& \it robust-o \\
\textsc{pron}.1\textsc{s} \& want-1\textsc{s} \& cross-\textsc{inf} \& \textsc{det}.\textsc{s}.\textsc{msc} \& bridge.\textsc{s}.\textsc{msc} \& sturdy-\textsc{s}.\textsc{msc} \\
\end{deptext}
\depedge[style={font=\Large}]{2}{1}{\textbf{nsubj}}
\deproot[edge unit distance=1.75ex, style={font=\Large}]{2}{\textbf{root}}
\depedge[style={font=\Large}]{2}{3}{\textbf{xcomp}}
\depedge[style={font=\Large}]{5}{4}{\textbf{det}}
\depedge[edge unit distance=2.5ex, style={font=\Large}]{3}{5}{\textbf{dobj}}
\depedge[style={font=\Large}]{5}{6}{\textbf{amod}}
\end{dependency}
\caption{Dependency tree for the sentence, \word{"Yo quiero cruzar un puente robusto."}}
\label{fig:tree}
\end{figure*}

In this paper, we assume that a writer's choice of words in written
text is as informative as a speaker's choice of words in a laboratory
experiment, despite the obvious differences between these
settings. Consequently, we use large-scale corpora and tools from NLP
and information theory, enabling us to test for the presence of even
relatively weak relationships involving the grammatical genders of
inanimate nouns across multiple different gendered languages. We
therefore argue that our findings complement, rather than supersede,
laboratory experiments.\looseness=-1

\subsection{Related Work}

Our paper is not the first to use large-scale corpora and tools from
NLP to investigate gender and language. Many scholars have studied the
ways that societal norms and stereotypes, including gender norms and
stereotypes, can be reflected in representations of distributional
semantics derived from large-scale corpora, such as word embeddings
\citep{bolukbasi2016man,caliskan2017semantics, garg2018word,
  zhao-etal-2018-learning}. More recently, \newcite{williams2019}
found that the grammatical genders of inanimate nouns in eighteen
different languages were correlated with their lexical
semantics. \citet{dye2017functional} used tools from information
theory to reject the idea that the grammatical genders of nouns
separate those nouns into coherent categories, arguing instead that
grammatical genders are only meaningful in that they systematically
facilitate communication efficiency by reducing nominal entropy. Also
relevant to our paper is the work of \newcite{kann2019}, who proposed
a computational approach to testing whether there is a relationship
between the grammatical genders of inanimate nouns and the words that
co-occur with those nouns, operationalized via word
embeddings. However, in contrast to our findings, they found no
evidence for the presence of such a relationship. Finally, many
scholars have proposed a variety of computational techniques for
mitigating gender norms and stereotypes in a wide range of
language-based applications
\citep{dev2019attenuating,dinan2019queens,ethayarajh-etal-2019-understanding,hall-maudslay-etal-2019-name,
  stanovsky-etal-2019-evaluating, tan2019assessing,
  zhou-etal-2019-examining,zmigrod-etal-2019-counterfactual}.\looseness=-1

\section{Data Preparation}\label{sec:preparation}

We use the May, 2018 dump of Wikipedia to create a corpus for each of
the six\xspace different gendered languages (i.e., German, Italian, Polish,
Portuguese, Russian, and Spanish). Although Wikipedia is not the most
representative data source, this choice yields language-specific
corpora that are roughly parallel---i.e., they refer to the same
objects, but are not direct translations of each other (which could
lead to artificial word choices). We use UDPipe 1.0 to tokenize each
corpus
\citep{straka2016}.\footnote{\url{http://ufal.mff.cuni.cz/udpipe}}\looseness=-1

We dependency parse the corpus for each language using a
language-specific dependency parser \citep{andor2016, alberti2017},
trained using Universal Dependencies treebanks
\citep{11234/1-1983}. An example dependency tree is shown in
\cref{fig:tree}. We then extract all noun--adjective pairs (dependency
arcs labeled \textsc{amod}) and noun--verb pairs from each of the six
corpora; for verbs, we extract three types of pairs, reflecting the
fact that nouns can be direct objects (dependency arcs labeled \textsc{dobj}\xspace),
indirect objects (dependency arcs labeled \textsc{iobj}\xspace), or subjects
(dependency arcs labeled \textsc{nsubj}\xspace) of verbs. We discard all pairs that
contain a noun that isn't present in
WordNet~\cite{princeton2010}.\footnote{\url{https://wordnet.princeton.edu/}}
We label the remaining nouns as ``animate'' or ``inanimate'' according
to WordNet.

Next, we lemmatize all words (i.e., nouns, adjectives, and
verbs). Each word is factored into a set of lexical features
consisting of a lemma, or canonical morphological form, and a bundle
of three morphological features corresponding to the grammatical
gender, number, and case of that word. For example, the German word
for a fork, \word{Gabel}, is grammatically feminine, singular, and
genitive. For nouns, we discard the lemmas themselves and retain only
the morphological features; for adjectives and verbs, we retain the
lemmas and discard the morphological features.\looseness=-1

For adjectives and verbs, lemmatizing is especially important because
it ensures that our tests do not simply reflect the presence of
gender agreement, as we describe in Section
\ref{sec:grammatical-gender}. However, this means that if the
lemmatizer fails, then our tests \emph{may} simply reflect
gender agreement despite our best efforts. To guard against this, we
use a state-of-the-art lemmatizer \cite{muller2015}, trained for each
language using Universal Dependencies treebanks
\citep{11234/1-1983}. We expect that when the lemmatizer fails, the
resulting lemmata will be low-frequency. We try to exclude
lemmatization failures from our calculations by discarding
low-frequency lemmata. For each language, we rank the adjective
lemmata by their token counts and retain only the highest-ranked
lemmata (in rank order) that account for 90\% of the adjective tokens;
we then discard all noun--adjective pairs that do not contain one of
these lemmata. We repeat the same process for verbs.\looseness=-1

Finally, to ensure that our tests reflect the most salient
relationships, we also discard low-frequency inanimate nouns and,
separately, low-frequency animate nouns using the same process. We
provide counts of the remaining noun--adjective and noun--verb pairs
in \cref{tab:inanimate_counts} (for inanimate nouns) and
\cref{tab:animate_counts} (for animate nouns).\looseness=-1

\section{Methodology}\label{sec:method}

For each language $\ell \in \{\textit{de},\textit{it}, \textit{pl},
\textit{pt}, \textit{ru}, \textit{es}\}$, we define
${\cal V}^{\ell}_{\textsc{adj}}$ to be the set of adjective lemmata
represented in the noun--adjective pairs retained for that language as
defined above. We similarly define ${\cal V}^\ell_\textsc{verb}$ to be
the set of verb lemmata represented in the noun--verb pairs retained
for that language as described above. We then define
${\cal V}^\ell_{\textsc{verb-dobj}} \subset {\cal V}^\ell_\textsc{verb}$,
${\cal V}^\ell_{\textsc{verb-iobj}} \subset {\cal V}^\ell_\textsc{verb}$,
and ${\cal V}^\ell_{\textsc{verb-subj}} \subset {\cal V}^\ell_\textsc{verb}$
to be the sets of verbs that take the nouns as direct objects, as
indirect objects, and as subjects, respectively. We also define
${\cal G}^\ell$ to be the set of grammatical genders for that language
(e.g., ${\cal G}^\textit{es} = \{\textsc{msc}, \textsc{fem}\}$), ${\cal C}^\ell$ to be the
set of cases (e.g., ${\cal C}^\textit{de} = \{\textsc{nom}, \textsc{acc}, \textsc{gen}, \textsc{dat}\}$),
and ${\cal N}^\ell$ to be the set of numbers (e.g., ${\cal N}^\textit{pt} =
\{\textsc{pl}, \textsc{sg}\}$). Finally, we define fourteen random variables:
$A^\ell_{i}$ and $A^\ell_{a}$ are ${\cal V}^\ell_{\textsc{adj}}$-valued
random variables, $D_{i}^\ell$ and $D_a^\ell$ are
${\cal V}^\ell_{\textsc{verb-dobj}}$-valued random variables, $I^\ell_i$
and $I^\ell_a$ are ${\cal V}^\ell_{\textsc{verb-iobj}}$-valued random
variables, $S^\ell_i$ and $S^\ell_a$ are
${\cal V}^\ell_{\textsc{verb-subj}}$-valued random variables, $G_i^\ell$
and $G_a^\ell$ are ${\cal G}^\ell$-valued random variables, $C_i^\ell$
and $C_a^\ell$ are ${\cal C}^\ell$-valued random variables, and
$N_i^\ell$ and $N_a^\ell$ are ${\cal N}^\ell$-valued random
variables. The subscripts ``$i$'' and ``$a$'' denote inanimate and
animate nouns, respectively.\looseness=-1

To test whether there is a relationship between the grammatical
genders of inanimate nouns and the adjectives used to describe those
nouns for language $\ell$, we calculate the mutual information
(MI)---a measure of the mutual statistical dependence between two
random variables---between $G_i^\ell$ and $A_i^\ell$:
\begin{align}
  &{\mathrm{MI}}(G_i^\ell; A_i^\ell) \notag\\
  &\quad= \sum_{g \in {\cal G}^\ell} \sum_{a \in V_\textsc{adj}^\ell} P(g, a) \log_2 \frac{P_i(g, a)}{P_i(g)\, P_i(a)},
  \end{align}
where all probabilities are calculated with respect to inanimate nouns
only.  If $G_i^\ell$ and $A_i^\ell$ are independent---i.e., there is
no relationship between them---then ${\mathrm{MI}}(G_i^\ell; A_i^\ell) = 0$; if
$G_i^\ell$ and $A_i^\ell$ are maximally dependent then ${\mathrm{MI}}(G_i^\ell;
A_i^\ell) = {\min\{{\mathrm{H}}(G_i^\ell), {\mathrm{H}}(A_i^\ell)\}}$, where
${\mathrm{H}}(G_i^\ell)$ is the entropy of $G_i^\ell$ and ${\mathrm{H}}(A_i^\ell)$ is
the entropy of $A_i^\ell$. For simplicity, we use plug-in estimates
for all probabilities (i.e., empirical probabilities), deferring the
use of more sophisticated estimators for future work. We note that
${\mathrm{MI}}(G_i^\ell, A_i^\ell)$ can be calculated in ${\cal
  O}\left(|{\cal G}^\ell|\cdot |V_\textsc{adj}^\ell|\right)$ time; however,
$|{\cal G}^\ell|$ is negligible (i.e, two or three) so the main cost is
$|V_\textsc{adj}^\ell|$.

To test for statistical significance, we perform a permutation
test. Specifically, we permute the grammatical genders of the
inanimate nouns 10,000 times and, for each permutation, recalculate
the MI between $G_i^\ell$ and $A_i^\ell$ using the permuted
genders. We obtain a $p$-value by calculating the percentage of
permutations that have a higher MI than the MI obtained using the
non-permuted genders; if the $p$-value is less than $0.05$, then we
treat the relationship between $G_i^\ell$ and $A_i^\ell$ as
statistically significant.

Because the maximum possible MI between any pair of random variables
depends on the entropies of those variables, MI values are not
comparable across pairs of random variables. We therefore also
calculate the normalized MI (NMI) between $G_i^\ell$ and $A_i^\ell$ by
normalizing ${\mathrm{MI}}(G_i^\ell, A_i^\ell)$ to lie between zero and one. The
most obvious choice of normalizer is the maximum possible MI---i.e.,
${\min\{{\mathrm{H}}(G_i^\ell), {\mathrm{H}}(A_i^\ell)\}}$---however, various other
normalizers have been proposed, each of which has different advantages
and disadvantages \cite{gates2019}. We therefore calculate six
different variants of ${\mathrm{NMI}}(G_i^\ell, A_i^\ell)$ using the following
normalizers:\looseness=-1
\begin{gather}
\label{eq:norm1}
 {\min\{{\mathrm{H}}(G_i^\ell), {\mathrm{H}}(A_i^\ell)\}}\\
 \label{eq:norm2}
 \sqrt{{\mathrm{H}}(G_i^\ell){\mathrm{H}}(A_i^\ell)}\\
 \label{eq:norm3}
 \frac{{\mathrm{H}}(G_i^\ell) + {\mathrm{H}}(A_i^\ell)}{2}\\
 \label{eq:norm4}
 {\max\{{\mathrm{H}}(G_i^\ell), {\mathrm{H}}(A_i^\ell)\}}\\
 \label{eq:norm5}
 {\max{\{\log{|{\cal G}^\ell|}, \log{|{\cal V}^\ell_{\textsc{adj}}|}\}}}\\
 \label{eq:norm6}
 \log{M_i^\ell},
 \end{gather}
where $M_i^\ell$ is the number of non-unique (inanimate)
noun--adjective pairs retained for that language.

To test whether there are relationships between the grammatical
genders of inanimate nouns and the verbs that take those nouns as
direct objects, as indirect objects, and as subjects, we calculate
${\mathrm{MI}}(G_i^\ell, D_i^\ell)$, ${\mathrm{MI}}(G_i^\ell, I_i^\ell)$, and ${\mathrm{MI}}(G^\ell,
S_i^\ell)$. Again, all probabilities are calculated with respect to
inanimate nouns only, and we perform permutation tests to test for
statistical significance. We also calculate six NMI variants for each
of the three pairs of random variables, using normalizers that are
analogous to those in \Cref{eq:norm1} through \Cref{eq:norm6}.

As a baseline, we test whether there are relationships between the
grammatical genders of inanimate nouns and the cases and numbers of
those nouns---i.e., we calculate ${\mathrm{MI}}(G_i^\ell, C_i^\ell)$ and
${\mathrm{MI}}(G_i^\ell, N^\ell_i)$ using probabilities that are calculated with
respect to inanimate nouns only. Again, we perform permutation tests
(but we do not expect that there will be statistically significant
relationships), and we calculate six NMI variants for each pair of
random variables using normalizers that are~analogous to those in
\Cref{eq:norm1} through \Cref{eq:norm6}.

Finally, we calculate ${\mathrm{MI}}(G_a^\ell, A_a^\ell)$, ${\mathrm{MI}}(G_a^\ell,
D_a^\ell)$, ${\mathrm{MI}}(G_a^\ell, I_a^\ell)$, ${\mathrm{MI}}(G_a^\ell, S_a^\ell)$,
${\mathrm{MI}}(G_a^\ell, C_a^\ell)$, and ${\mathrm{MI}}(G_a^\ell, N_a^\ell)$) using
probabilities calculated with respect to \emph{animate} nouns
only. The first five of these are intended to serve as a ``skyline,''
while the last two are intended to serve as a sanity check (i.e., we
expect them to be close to zero, as with inanimate nouns). Again, we
perform permutation tests to test for statistical significance, and we
calculate six~NMI variants for each pair of random
variables.\looseness=-1

\section{Results}\label{sec:experiment1}

\begin{table*}[th]
  \centering
  \small
  \begin{tabular}{l  c c c c c c }
  \toprule
  & \textit{de} &
  \textit{it} &
  \textit{pl} &
  \textit{pt} &
  \textit{ru} &
  \textit{es}\\
  \midrule
  ${\mathrm{MI}}(G_i^\ell, A_i^\ell)$ & \textbf{0.0310} & \textbf{0.0500} & \textbf{0.0225} & \textbf{0.0400} & \textbf{0.0520} & \textbf{0.0664}\\
  ${\mathrm{MI}}(G_i^\ell, D_i^\ell)$ & \textbf{0.0290} & \textbf{0.0232} & \textbf{0.0109} & \textbf{0.0129} & \textbf{0.0440} & \textbf{0.0090}\\
  ${\mathrm{MI}}(G_i^\ell, I_i^\ell)$ & \textbf{0.0743} & 0.6973 & \textbf{0.0514} & \textbf{0.0230} & \textbf{0.0640} & \textbf{0.0184}\\
  ${\mathrm{MI}}(G_i^\ell, S_i^\ell)$ & \textbf{0.0276} & \textbf{0.0274} & \textbf{0.0226} & \textbf{0.0090} & \textbf{0.0270} & \textbf{0.0090}\\
      ${\mathrm{MI}}(G_i^\ell, C_i^\ell)$ & $<$ 0.001 & N/A & $<$ 0.001  & N/A & $<$ 0.001  &  N/A \\
      ${\mathrm{MI}}(G_i^\ell, N_i^\ell)$ & $<$ 0.001  &$<$ 0.001  & $<$0.001  & $<$0.001  & $<$ 0.001 & $<$ 0.001 \\
\bottomrule
  \end{tabular}
    \caption{The mutual information (MI) between the grammatical
      genders of inanimate nouns and a) the adjectives used to
      describe those nouns (top row), b) the verbs that take those
      nouns as direct objects, as indirect objects, and as subjects
      (rows 2--4, respectively), and c) the cases and numbers of those
      nouns (rows 5 and 6, respectively) for six\xspace different gendered
      languages. Statistical significance (i.e., a $p$-value less than
      0.05) is indicated using bold. MI values are not comparable
      across pairs of random variables.\looseness=-1}
    \vspace{1.0em}
  \label{tab:mi_significance}
  \end{table*}

In the first row of \cref{tab:mi_significance}, we provide the MI
between $G_i^\ell$ and $A_i^\ell$ for each language $\ell \in
\{\textit{de}, \textit{it}, \textit{pl}, \textit{pt}, \textit{ru},
\textit{es}\}$. For all six languages, ${\mathrm{MI}} (G_i^\ell, A_i^\ell)$ is
statistically significant (i.e., $p < 0.05$), meaning that there is a
relationship between the grammatical genders of inanimate nouns and
the adjectives used to describe those nouns. Rows 2--4 of
\cref{tab:mi_significance} contain ${\mathrm{MI}}(G_i^\ell,D_i^\ell)$,
${\mathrm{MI}}(G_i^\ell,I_i^\ell)$, and ${\mathrm{MI}}(G^\ell,S_i^\ell)$ for each
language. For all six languages, ${\mathrm{MI}}(G_i^\ell,D_i^\ell)$ and
${\mathrm{MI}}(G_i^\ell,S_i^\ell)$ are statistically significant (i.e., $p <
0.05$). For five of the six languages, ${\mathrm{MI}}(G_i^\ell,I_i^\ell)$ is
statistically significant, but because of the small number of
noun--verb pairs involved, we caution against reading too much into
this finding. We note that direct objects are closest to verbs in
analyses of constituent structures, followed by subjects and then
indirect objects \cite{chomsky1957, adger2003}. Finally, the last two
rows of \cref{tab:mi_significance} contain ${\mathrm{MI}}(G_i^\ell, C_i^\ell)$
and ${\mathrm{MI}}(G_i^\ell, N_i^\ell)$, respectively, for each language. We do
not find any statistically significant relationships for either case
or number.\looseness=-1

\begin{figure*}
  \centering
  \small
  \includegraphics[width=0.7\textwidth]{figures/allInanim.pdf}
  \caption{The normalized mutual information (NMI) between the
    grammatical genders of inanimate nouns and a) the adjectives used
    to describe those nouns b) the verbs that take those nouns as
    direct objects and as subjects for six\xspace different gendered
    languages. Each subplot contains six variants of~${\mathrm{NMI}}(G_i^\ell,
    A_i^\ell)$, ${\mathrm{NMI}}(G_i^\ell,D_i^\ell)$, and
    ${\mathrm{NMI}}(G_i^\ell,S_i^\ell)$---one per normalizer---for a single
    language $\ell \in \{\textit{de}, \textit{it}, \textit{pl},
    \textit{pt}, \textit{ru}, \textit{es}\}$.}
  \label{fig:nmi_inanimates}
\end{figure*}

To facilitate comparisons, each subplot in \cref{fig:nmi_inanimates}
contains six variants of ${\mathrm{NMI}}(G_i^\ell, A_i^\ell)$,
${\mathrm{NMI}}(G_i^\ell,D_i^\ell)$, and ${\mathrm{NMI}}(G_i^\ell,S_i^\ell)$, calculated
using normalizers that are analogous to those in \Cref{eq:norm1}
through \Cref{eq:norm6}, for a single language $\ell \in \{\textit{de},
\textit{it}, \textit{pl}, \textit{pt}, \textit{ru},
\textit{es}\}$. (We omit ${\mathrm{NMI}}(G_i^\ell,I_i^\ell)$ from each plot
because of the small number of noun--verb pairs involved.)
For $\ell \in \{ \textit{it},
\textit{pl}, \textit{pt}, \textit{es}\}$, ${\mathrm{NMI}}(G_i^\ell, A_i^\ell)$
is larger than ${\mathrm{NMI}}(G_i^\ell,D_i^\ell)$ and
${\mathrm{NMI}}(G_i^\ell,S_i^\ell)$, regardless of the normalizer. For $\ell \in
\{\textit{it}, \textit{pl}\}$, ${\mathrm{NMI}}(G_i^\ell,S_i^\ell)$ is larger
than ${\mathrm{NMI}}(G_i^\ell,D_i^\ell)$;
${\mathrm{NMI}}(G_i^\textit{pt},D_i^\textit{pt})$ is larger than
${\mathrm{NMI}}(G_i^\textit{pt},S_i^\textit{pt})$; and
${\mathrm{NMI}}(G_i^\textit{es},D_i^\textit{es})$ and
${\mathrm{NMI}}(G_i^\textit{es},S_i^\textit{es})$ are roughly
comparable---again, all regardless of the normalizer. Meanwhile,
${\mathrm{NMI}}(G_i^\textit{de}, A_i^\textit{de})$ is larger than
${\mathrm{NMI}}(G_i^\textit{de},D_i^\textit{de})$ and
${\mathrm{NMI}}(G_i^\textit{de},S_i^\textit{de})$ for the normalizer in
\Cref{eq:norm1}, while ${\mathrm{NMI}}(G_i^\textit{de}, A_i^\textit{de})$,
${\mathrm{NMI}}(G_i^\textit{de},D_i^\textit{de})$, and
${\mathrm{NMI}}(G_i^\textit{de},S_i^\textit{de})$ are all roughly comparable for
the other five normalizers. Finally, ${\mathrm{NMI}}(G_i^\textit{ru},
A_i^\textit{ru})$ and ${\mathrm{NMI}}(G_i^\textit{ru},D_i^\textit{ru})$ are
roughly comparable and larger than
${\mathrm{NMI}}(G_i^\textit{ru},S_i^\textit{ru})$, regardless of the
normalizer.\looseness=-1

In other words, the relationship between the grammatical genders of
inanimate nouns and the adjectives used to describe those nouns is
generally stronger than, but sometimes roughly comparable to, the
relationships between the grammatical genders of inanimate nouns and
the verbs that take those nouns as direct objects and as
subjects. However, the relative strengths of the relationships between
the grammatical genders of inanimate nouns and the verbs that take
those nouns as direct objects and as subjects vary depending on the
language.\looseness=-1

\begin{table*}
  \centering
  \small
  \begin{tabular}{l  c c c c c c }
  \toprule
  & \textit{de} &
  \textit{it} &
  \textit{pl} &
  \textit{pt} &
  \textit{ru} &
  \textit{es}\\
  \midrule
  ${\mathrm{MI}}(G_a^\ell, A_a^\ell)$ & \textbf{0.0928} & \textbf{0.1316} & \textbf{0.0621} & \textbf{0.0933} & \textbf{0.0845} & \textbf{0.1111}\\
  ${\mathrm{MI}}(G_a^\ell, D_a^\ell)$ & \textbf{0.0410} & \textbf{0.0543} & \textbf{0.0273} & \textbf{0.0320} & \textbf{0.0664} & \textbf{0.0091} \\
  ${\mathrm{MI}}(G_a^\ell, I_a^\ell)$ & \textbf{0.0737} & \textbf{0.0543} & \textbf{0.0439} & \textbf{0.0687} & \textbf{0.0600} & \textbf{0.0358}\\
  ${\mathrm{MI}}(G_a^\ell, S_a^\ell)$ & \textbf{0.0343} & \textbf{0.0543} & \textbf{0.0258} & \textbf{0.0252} & \textbf{0.0303} & \textbf{0.0192} \\
  ${\mathrm{MI}}(G_a^\ell, C_a^\ell)$ & $<$ 0.001 &  N/A & $<$ 0.001  & N/A & $<$ 0.001  & N/A \\
  ${\mathrm{MI}}(G_a^\ell, N_a^\ell)$ & $<$ 0.001  &$<$ 0.001  & $<$ 0.001  & $<$ 0.001  & $<$ 0.001 & $<$ 0.001\\
\bottomrule
  \end{tabular}
    \caption{The mutual information (MI) between the grammatical genders of animate nouns and a) the adjectives used to describe those nouns (top row), b) the verbs that take those nouns as direct objects, as indirect objects, and as subjects (rows 2--4, respectively), and c) the cases and numbers of those nouns (rows 5 and 6, respectively) for six\xspace different gendered languages. Statistical significance (i.e., a $p$-value less than 0.05) is indicated using bold. MI values are not comparable across pairs of random variables.\looseness=-1}
  \label{tab:mi_significance_animate}
  \end{table*}

In \cref{tab:mi_significance_animate}, we provide ${\mathrm{MI}}(G_a^\ell,
A_a^\ell)$, ${\mathrm{MI}}(G_a^\ell, D_a^\ell)$, ${\mathrm{MI}}(G_a^\ell, I_a^\ell)$,
${\mathrm{MI}}(G_a^\ell, S_a^\ell)$, ${\mathrm{MI}}(G_a^\ell, C_a^\ell)$, and
${\mathrm{MI}}(G_a^\ell, N_a^\ell)$ for each language $\ell \in \{\textit{de},
\textit{it}, \textit{pl}, \textit{pt}, \textit{ru}, \textit{es}\}$. As
with inanimate nouns, we find that there is a statistically
significant relationship between the grammatical genders of animate
nouns and the adjectives used to describe those nouns. We also find
that there are statistically significant relationships between the
grammatical genders of animate nouns and the verbs that take those
nouns as direct objects, as indirect objects, and as subjects. Again,
the relationship for the
verbs that take those nouns as indirect objects involves a small
number of noun--verb pairs. As expected, we do not find any
statistically significant relationships for either case or
number.\looseness=-1

\begin{figure*}
  \centering
  \small
  \includegraphics[width=0.7\textwidth]{figures/allAnim.pdf}
  \caption{The normalized mutual information (NMI) between the
    grammatical genders of animate nouns and a) the adjectives used to
    describe those nouns b) the verbs that take those nouns as direct
    objects and as subjects for six\xspace different gendered languages. Each
    subplot contains six variants of~${\mathrm{NMI}}(G_a^\ell, A_a^\ell)$,
    ${\mathrm{NMI}}(G_a^\ell,D_a^\ell)$, and ${\mathrm{NMI}}(G_a^\ell,S_a^\ell)$---one
    per normalizer---for a single language $\ell \in \{\textit{de},
    \textit{it}, \textit{pl}, \textit{pt}, \textit{ru},
    \textit{es}\}$.}
  \label{fig:nmi_animates}
\end{figure*}

\Cref{fig:nmi_animates} is analogous to \Cref{fig:nmi_inanimates}, in
that each subplot contains six variants of ${\mathrm{NMI}}(G_a^\ell, A_a^\ell)$,
${\mathrm{NMI}}(G_a^\ell,D_a^\ell)$, and ${\mathrm{NMI}}(G_a^\ell,S_a^\ell)$, calculated
using normalizers that are analogous to those in \Cref{eq:norm1}
through \Cref{eq:norm6}, for a single language $\ell \in
\{\textit{de}, \textit{it}, \textit{pl}, \textit{pt}, \textit{ru},
\textit{es}\}$. (As with inanimate nouns, we omit
${\mathrm{NMI}}(G_a^\ell,I_a^\ell)$ from each plot because of the small number
of noun--verb pairs involved.)
For $\ell \in \{\textit{de}, \textit{it}, \textit{pl},
\textit{pt}, \textit{es}\}$, ${\mathrm{NMI}}(G_i^\ell, A_i^\ell)$ is larger than
${\mathrm{NMI}}(G_i^\ell,D_i^\ell)$ and ${\mathrm{NMI}}(G_i^\ell,S_i^\ell)$, regardless of
the normalizer. For $\ell \in \{\textit{it}, \textit{pl}\}$,
${\mathrm{NMI}}(G_i^\ell,S_i^\ell)$ is larger than ${\mathrm{NMI}}(G_i^\ell,D_i^\ell)$;
for $\ell \in \{\textit{de}, \textit{pt}\}$, ${\mathrm{NMI}}(G_i^\ell,D_i^\ell)$
is larger than ${\mathrm{NMI}}(G_i^\ell,S_i^\ell)$; and
${\mathrm{NMI}}(G_i^\textit{es},D_i^\textit{es})$ and
${\mathrm{NMI}}(G_i^\textit{es},S_i^\textit{es})$ are roughly
comparable---again, all regardless of the normalizer. Meanwhile,
${\mathrm{NMI}}(G_i^\textit{ru}, A_i^\textit{ru})$ is larger than
${\mathrm{NMI}}(G_i^\textit{ru},D_i^\textit{ru})$ which is larger than
${\mathrm{NMI}}(G_i^\textit{ru},S_i^\textit{ru})$ for the normalizers in
\Cref{eq:norm1} and \Cref{eq:norm2}, while ${\mathrm{NMI}}(G_i^\textit{ru},
A_i^\textit{ru})$ and ${\mathrm{NMI}}(G_i^\textit{ru},D_i^\textit{ru})$ are
roughly comparable and larger than
${\mathrm{NMI}}(G_i^\textit{ru},S_i^\textit{ru})$ for the other five normalizers.\looseness=-1

Finally, each subplot in \Cref{fig:nmi_both_adj} contains
${\mathrm{NMI}}(G_i^\ell, A_i^\ell)$ and ${\mathrm{NMI}}(G_a^\ell, A_a^\ell)$, calculated
using a single normalizer, for each for each language $\ell \in
\{\textit{de}, \textit{it}, \textit{pl}, \textit{pt}, \textit{ru},
\textit{es}\}$. Each subplot in \Cref{fig:nmi_both_dobj} analogously
contains ${\mathrm{NMI}}(G_i^\ell, D_i^\ell)$ and ${\mathrm{NMI}}(G_a^\ell, D_a^\ell)$,
while each subplot in \Cref{fig:nmi_both_subj} contains
${\mathrm{NMI}}(G_i^\ell, S_i^\ell)$ and ${\mathrm{NMI}}(G_a^\ell, S_a^\ell)$. The NMI
values for animate nouns are generally larger than the NMI values for
inanimate nouns. The only exception is Polish, where
${\mathrm{NMI}}(G_i^\textit{pl}, A_i^\textit{pl})$ is larger than
${\mathrm{NMI}}(G_a^\textit{pl}, A_a^\textit{pl})$, regardless of the
normalizer.

\begin{figure*}
  \centering
  \small
  \includegraphics[width=0.7\textwidth]{figures/ADJAllNorms.pdf}
   \caption{The normalized mutual information (NMI) between the
     grammatical genders of a) inanimate and b) animate nouns and the
     adjectives used to describe those nouns. Each subplot contains
     ${\mathrm{NMI}}(G^\ell_i, A_i^\ell)$ and ${\mathrm{NMI}}(G^\ell_a, A_a^\ell)$,
     calculated using a single normalizer, for each language $\ell \in
     \{\textit{de}, \textit{it}, \textit{pl}, \textit{pt},
     \textit{ru}, \textit{es}\}$.}
  \label{fig:nmi_both_adj}
\end{figure*}

\begin{figure*}
  \centering
  \small
  \includegraphics[width=0.7\textwidth]{figures/DOBJAllNorms.pdf}
   \caption{The normalized mutual information (NMI) between the
     grammatical genders of a) inanimate and b) animate nouns and the
     verbs that take those nouns as direct objects. Each subplot
     contains ${\mathrm{NMI}}(G^\ell_i, D_i^\ell)$ and ${\mathrm{NMI}}(G^\ell_a,
     D_a^\ell)$, calculated using a single normalizer, for each
     language $\ell \in \{\textit{de}, \textit{it}, \textit{pl},
     \textit{pt}, \textit{ru}, \textit{es}\}$.}
  \label{fig:nmi_both_dobj}
\end{figure*}

\begin{figure*}
  \centering
  \small
  \includegraphics[width=0.7\textwidth]{figures/SUBJAllNorms.pdf}
   \caption{The normalized mutual information (NMI) between the
     grammatical genders of a) inanimate and b) animate nouns and the
     verbs that take those nouns as subjects. Each subplot contains
     ${\mathrm{NMI}}(G^\ell_i, S_i^\ell)$ and ${\mathrm{NMI}}(G^\ell_a, S_a^\ell)$,
     calculated using a single normalizer, for each language $\ell \in
     \{\textit{de}, \textit{it}, \textit{pl}, \textit{pt},
     \textit{ru}, \textit{es}\}$.}
  \label{fig:nmi_both_subj}
  \end{figure*}

\section{Discussion}

We find evidence for the presence of a statistically significant
relationship between the grammatical genders of inanimate nouns and
the adjectives used to describe those nouns for six different gendered
languages (specifically, German, Italian, Polish, Portuguese, Russian,
and Spanish). We also find evidence for the presence of statistically
significant relationships between the grammatical genders of inanimate
nouns and the verbs that take those nouns as direct objects, as
indirect objects, and as subjects. However, we caution against reading
too much into the relationship for the verbs that take those nouns as
indirect objects because of the small number of noun--verb pairs
involved. The effect sizes (operationalized as NMI values) for all of
these relationships are smaller than the effect sizes for animate
nouns. As expected, we do not find any statistically significant
relationships for either case or number.\looseness=-1

We emphasize that our findings complement, rather than supersede,
laboratory experiments, such as that of \citet{boroditsky2003sex}. We
use large-scale corpora and tools from NLP and information theory to
test for the presence of even relatively weak relationships across
multiple different gendered languages---and, indeed, the relationships
that we find have effect sizes (operationalized as NMI values) that
are small. In contrast, laboratory experiments typically focus on much
stronger relationships by tightly controlling experimental conditions
and measuring speakers' immediate, real-time speech
production. Moreover, although we find statistically
significant relationships, we do not investigate the characteristics
of these relationships. This means that we do not know whether they
are characterized by gender stereotypes, as argued by some cognitive
scientists, including \citet{boroditsky2003sex}. We also do not know
whether the relationships that we find are causal in nature. Because
MI is symmetric, our findings say nothing about whether the
grammatical genders of inanimate nouns \emph{cause} writers to choose
particular adjectives or verbs. We defer a deeper investigation of
these both of these avenues for future work.

Finally, we note that each of our tests can be viewed as a comparison
of the similarity of two clusterings of a set of items---specifically,
a ``clustering'' of nouns into grammatical genders and a
``clustering'' of the same nouns into, e.g., adjective
lemmata. Although (normalized) MI is a standard measure for comparing
clusterings, it is not without limitations (see, e.g.,
\citet{newman20} for an overview). For future work, we therefore
recommend replicating our tests using other information-theoretic
measures for comparing clusterings.\looseness=-1

\section*{Acknowledgments}

We thank Lera Boroditsky, Hagen Blix, Eleanor Chodroff, Andrei
Cimpian, Zach Davis, Jason Eisner, Richard Futrell, Todd Gureckis,
Katharina Kann, Peter Klecha, Zhiwei Li, Ethan Ludwin-Peery, Alec
Marantz, Arya McCarthy, John McWhorter, Sabrina J. Mielke, Elizabeth
Salesky, Arturs Semenuks, and Colin Wilson for discussions at various
points related to the ideas in this paper.