Contextual-Relation Consistent Domain Adaptation for Semantic Segmentation

Recent advances in unsupervised domain adaptation for semantic segmentation have shown great potentials to relieve the demand of expensive per-pixel annotations. However, most existing works address the domain discrepancy by aligning the data distributions of two domains at a global image level whereas the local consistencies are largely neglected. This paper presents an innovative local contextual-relation consistent domain adaptation (CrCDA) technique that aims to achieve local-level consistencies during the global-level alignment. The idea is to take a closer look at region-wise feature representations and align them for local-level consistencies. Specifically, CrCDA learns and enforces the prototypical local contextual-relations explicitly in the feature space of a labelled source domain while transferring them to an unlabelled target domain via backpropagation-based adversarial learning. An adaptive entropy max-min adversarial learning scheme is designed to optimally align these hundreds of local contextual-relations across domain without requiring discriminator or extra computation overhead. The proposed CrCDA has been evaluated extensively over two challenging domain adaptive segmentation tasks (e.g., GTA5 to Cityscapes and SYNTHIA to Cityscapes), and experiments demonstrate its superior segmentation performance as compared with state-of-the-art methods.


Introduction
Semantic segmentation has been a longstanding challenge in computer vision, which aims to assign class labels to every pixel of an image [59]. Deep learning based approaches have achieved great successes at the price of large-scale densely-annotated datasets [3,27,9] which are prohibitively expensive to collect [9]. One way of circumventing this constraint is to use synthesized images with automatically generated labels (e.g., synthesized [36] or game-engine produced  [44,49,45] (e.g., probability-/entropy-/patch-represented output), which tends to introduce segmentation errors due to the neglect of local contextual consistency. Our CrCDA shown in the lower part adapts features at local level for contextual-relation consistency between the source and target domains which generates more accurate segmentation consistently. In the graph, "compatibility relations?refer to visual patterns with high co-occurrence frequency (e.g., "pole?should be beside the "sidewalk"), and "incompatibility relations?refer to visual patterns with low cooccurrence frequency (i.e., "sky" should not in the "building").
[35] data) in network training. Unfortunately, such models usually undergo a drastic performance drop when applied to real-world images [53] due to the domain bias and shift [39,32,44,48,40,30]. Unsupervised domain adaptation (UDA) has been introduced to address the domain bias/shift issue. To reduce the cross-domain discrepancy, most state-ofthe-art UDA methods [46,44,31,49,45,17] exploit adversarial learning for distri-bution alignment in the intermediate feature [46], output [44,31] or latent [45,49] space. Among this cohort of adversarial-based methods, a common and pivotal step is the employment of a discriminator [16] that predicts a domain label for data being either source or target domain. However, the discriminator works only on image-level and merely achieves global consistency (i.e., locational/spatial distributions consistency), where local contextual consistency (i.e., region-wise contextual-relationships) is largely neglected.
Local contextual-relationships are ubiquitous and provide important cues for scene segmentation. They can be formulated in terms of semantic compatibility/incompatibility relations between one thing/stuff and its neighbouring things/stuff. Under this formulation, a compatibility relation is an indication of visual patterns with high co-occurrence frequency, e.g. a pole beside a sidewalk, and an incompatibility relation is an indication of visual patterns with low co-occurrence frequency, e.g. a person above a driving car. The contextual information has been extensively explored in supervised semantic segmentation, whereas the local contextual-relationships is largely neglected in unsupervised domain adaptive semantic segmentation though theyre beneficial in addressing local contextual consistency and inconsistency in the target domain, as illustrated in Fig. 1.
To this end, we propose an unsupervised domain adaptation method for semantic segmentation that explicitly models the local contextual-relations in the feature space of source domain (with label) and then transfers this contextual information into the target domain (without label), ultimately improving target domain segmentation quality, as shown in Fig. 1. We first establish local contextual-relationships pseudo annotations in the source domain. This can be achieved by sampling regions from pixel-level ground-truth maps of source images and clustering the sampled regions to indexed N /M groups via Dbscan [12], as illustrated in Fig. 4. With the local contextual-relationships pseudo annotations in source domain, we can train a classifier C to explicitly models/learns the local contextual-relations in the feature space of source domain, and then transfers/enforces these local contextual-relations into target domain.
Following current discriminator-based global alignment methods [44,45,49,31], a intuitive idea is to employ hundreds of discriminators to align hundreds of contextual-relations across domain where a single discriminator focuses on a single contextual-relation, or employ just one discriminator to align all contextualrelations across domains. Obviously, the former is cumbersome which requires much redundant computation, while the latter is not aware of a variety of contextual-relations in the data distribution and may end up biasing to lowlevel/simple difference. Therefore, different from current discriminator-based global alignment methods [44,45,49,31], we enforce these local contextual-relations on target domain via adaptive entropy max-minimizing (AEMM) between classifier C and feature extractor E that estimates prototypical feature representations of these local contextual-relations and congregates neighboring target incorrect samples/contextual-relations to the approximated correct source prototypes alternatively, ultimately leading to consistent local contextual-relations across do-mains. In this way, our method requires no discriminator which is normally used in UDA-based semantic segmentation and introduces training instability and extra components. In addition, this AEMM learning scheme can also be applied into pixel-/global-scale training.
The contributions of this work can be summarized in three aspects. First, we propose an unsupervised domain adaptation method for semantic segmentation that explicitly models the local contextual-relations in the feature space of source domain (with label) and then transfers this contextual information into target domain (without label). To the best of our knowledge, this is the first effort to explore contextual information for UDA-based semantic segmentation. Second, it introduces a novel adaptive entropy max-minimizing adversarial learning scheme to effectively align hundreds of local contextual-relations across domain, which requires no discriminator and adds no overhead. Third, it shows the proposed method can be seamlessly integrated into existing domain adaptation techniques without extra overhead except two classifiers and achieves consistent improvements on semantic segmentation. Fourth, extensive evaluations over two challenging UDA tasks GTA5 → Cityscapes and SYNTHIA → Cityscapes show that our method achieves superior semantic segmentation performance consistently.
Adversarial learning based approach: Adversarial learning based UDA has been extensively explored for semantic segmentation, where a discriminator is employed to minimize the divergences between source and target domains in feature or output spaces. [19] first applies adversarial learning for UDA based semantic segmentation by aligning feature space at global scale. Curriculum domain adaptation [55] utilizes certain inferred properties (e.g., superpixel and global label distributions) as the guidance to train the segmentation network. In [44] and [7], the adversarial learning is used to align the global structure to benefit from the scene layout consistency across domains, where [7] integrates a target guided distillation module to achieve style adaptation. In addition, [38,39] combines adversarial learning and co-training to achieve domain adaptation via maximizing the discrepancy between two classifiers' outputs.
Image translation based approach: Inspired by the recent advances in image synthesis (e.g., CycleGAN [60]), a number of GAN-based methods are proposed to generate target images conditioned on the source, which can help reduce the domain discrepancy before training segmentation models. CyCADA [18] uses CycleGAN to generate target images conditioned on the source images and achieves input space adaptation with a joint adversarial learning for feature alignment. A similar method, DCAN [50], implements channel-wise feature alignment to preserve spatial structures and semantic concepts in the generator and segmentation network. [42] transfers the information of the target domain to the learned embedding via the joint adversarial learning between generator and discriminator. Besides using GANs [16] to align the embedding across domains, [62] proposes a novel conservative loss to penalize the extremely easy and difficult cases while enhancing moderate examples.
Re-training based approach: Another approach of UDA based semantic segmentation is pseudo label re-training [64,63,26] that uses high-confident predictions as pseudo ground truth for the target unlabelled data to finetune the model trained on the source data. In [64], class balancing and spatial prior are included to guide the iterative re-training in target domain. [49] proposes a soft-assigned version of re-training, where it enforces the "most-confused" pixels (e.g., with equal probabilities for all classes) to become more confident (i.e., with either low or high probability for each class) by entropy minimization. [64] instead implements iterative learning on high-confident pixels.
Our method does not follow either global/class-wise feature space alignment using discriminators [19,28,29,46,31,7] or re-training on target data [64,41]. Instead, we enforce multi-scale feature space alignment via multi-scale entropy max-minimizing. To the best of our knowledge, this is the first end-to-end multiscale UDA network that achieves competitive performance on two challenging UDA tasks.

Methods
In this section, we present our framework for contextual-relationships consistent domain adaptation (CrCDA): a discriminator-free adversarial training scheme between a feature extractor module and a classifier via adaptive entropy maxminimizing (AEMM) to align local contextual-relationships across domains. Fig.  2 illustrates our network architecture.

Problem Definition
We focus on the problem of unsupervised domain adaptation (UDA) in semantic segmentation. Given the source data X s ⊂ R H×W ×3 with C-class pixel-scale segmentation labels Y s ⊂ (1, C) H×W (e.g., stimulated images from game engines) and the target data X t ⊂ R H×W ×3 without labels (i.e., real images), our goal is to learn a semantic segmentation model G that performs well on the target dataset X t . Current adversarial learning methods rely heavily on discriminators to align the distributions of source and target domains via two loss functions: segmentation loss on source data and adversarial loss for alignment.
However, there exists a crucial limitation for these approaches: even if perfect adaptation is achieved through a discriminator, the alignment is implemented on global level (i.e., image-level), where local contextual information may be lost/deconstructed. The reason lies in that the discriminator can only implement alignment at global level, which inputs the whole map but outputs a digit to represent domain labels (e.g., 0 or 1). In some cases, parts of local regions (i.e., local contextual-relations) have been well aligned across domains. However, the discriminator might deconstruct this existing local alignment during implementing the global marginal distribution alignment. In this paper, we define this phenomenon as "lack of local consistency (i.e., local contextual inconsistency)", which is important to semantic segmentation in dense pixel-scale prediction.

Overview of Network Architecture
As shown in Fig. 2, our semantic segmentation model G consists of a feature extractor E and two classifiers (i.e., C seg and C cr ) where C seg is for pixel-scale segmentation and C cr is for local-scale contextual-relations learning/classification. E extracts features from input images. C seg and C cr classify features generated by E into pre-defined semantic classes. Specifically, C seg processes features at pixel-scale, which aims to predict pixel-scale labels. The pre-defined semantic class domain for C seg is the pixel-scale ground-truth, so there is no difference between C seg and traditional segmentation classifier. C cr processes features at local scales, which aims to predict region-scale/contextual-relations labels. The pre-defined semantic class domain for C cr is the clustered contextual-relations ground-truth. The establishment procedure of clustered contextual-relations labels is described in Section 3.3 and shown in Fig. 3. We train E and the classifiers (i.e., C seg and C cr ) in an adversarial scheme to reduce domain shifts at local scales to achieve local contextual-relation consistency.

Contextual-relation consistent domain adaptation
This subsection introduces our contextual-relation consistent domain adaptation at local scales, denoted as CrCDA * , via adaptive entropy max-minimizing, as shown in Fig. 2.
Contextual-relation pseudo label establishment. In order to implement local-scale task, we sample regions on the feature space and implement domain alignment at local scales to achieve local contextual-relation consistent domain adaptation, as shown in Fig. 3. Different from [22] that implements mode-agnostic patches alignment or [45] that aligns patch-indexed representation of the whole image only at global scales by a discriminator (i.e., the probability distributions of patch index prediction of the whole images.), we aim to aligns inter-class relations within each single patch, i.e., the probability distributions of pixel class prediction within each patch, w.r.t its mode via a classifier. Thus, the preliminary is to establish the region-scale label, where we first crop the pixel-scale ground-truth to many larger regions and then use Dbscan [12] to cluster them to assign each region a certain index label (i.e., contextual-relation pseudo label). Specifically, we assign the index label to regions according to the clustering results based on the histogram of gradient. For region-scale label (i.e., contextual-relation pseudo label), we cluster regions into different groups based on the histogram of gradient and assign the index label. These region-scale/contextual-relation pseudo labels can assist our network to implement alignment at local scales. Detailed information about the regionscale/contextual-relation pseudo labels is in the supplementary materials.  Adaptive entropy max-minimizing adversarial learning scheme. In local-scale adaptation, C cr aims to approximate the prototypical feature representations for each contextual-relation (e.g., road-sidewalk, sky-building, polesidewalk, etc.) by implementing entropy maximization in target domain according to the source prototypical feature representations found via supervised learning in source domain. E focuses on extracting discriminative feature representations (near the approximated prototypical feature representations) by implementing entropy minimization. Specifically, the prototypical feature representations of source domain found with supervision are first utilized to estimate the prototypical feature representations for target data by entropy maximizing w.r.t C cr . E then adapts the extracted feature representations to the corresponding prototypical feature representations by minimizing the entropy. The overall unsupervised domain adaptation at local scales is achieved by the adversarial training between C cr and E as illustrated in Fig. 4. Different from that applied in semi-supervised learning [37], our unsupervised domain adaptation training method, referred as adaptive entropy max-minimizing (AEMM) implements entropy max-min with a regularizer R(P ) = ave{P log P } × λ R (λ R decreases with training iteration, details are shown in appendix) for better estimating the prototypes in the target domain where no labels are available.
Source Flow. In our local-scale adaptation setting, the source data contributes to L seg and L cr . Given a source image x s ⊂ X s , its corresponding segmentation label y s ⊂ Y s and contextual-relation pseudo-label y s cr ⊂ Y s cr , P (h,w,c) s = C seg (E(x s )) is the predicted probability map w.r.t each pixel over C classes; P (i,j,n) s cr = C cr (E(x s )) is the predicted probability map w.r.t each region over N pre-defined contextual-relations classes. Therefore, it is a simple supervised learning objective to minimize L seg and L cr , which are expressed as: Target Flow. As the target label is not accessible, we introduce the adversarial training scheme between feature extractor E and classifier C cr to extract discriminative features for target data via adaptively max-minimizing entropy in target domain. Given a target image x t ⊂ X t , P (i,j,n) t cr = C cr (E(x t )) is the predicted probability map w.r.t each region over N pre-defined contextual-relations classes. The entropy loss L entcr is expressed as: For local-scale adaptation, we use the same back-propagation optimizing scheme with the gradient reverse layer mentioned in [57]. The training objective can be express as: where λ ent is a weight factor to control the balance of unsupervised adaptation on target data and supervised learning on source data.

CrCDA with pixel-/global-scale
This subsection introduces our CrCDA with pixel-/global-scale, denoted as Cr-CDA, via adaptive entropy max-minimizing, as shown in Fig. 2. Our discriminatorfree AEMM adversarial training scheme can also be extended into pixel-scale and global/image-scale to form multi-scale domain adaptation.
In multi-scale adaptation, for L seg , L cr and L ent cr , the objectives are the same as that in local-scale adaptation. We extend the AEMM adversarial training scheme mentioned before into pixel-scale and global-scale adaptation. For pixel-scale adaptation, we implement pixel-scale entropy loss L ent on target data to E and C seg . For global-scale adaptation, we implement global-scale entropy loss L ent D on target data to E and C D , where C D is a domain classifier. C D takes the layout probability map concatenated by the two probability maps generated from C seg and C cr as input, and predicts domain label for it (e.g., 0 for source domain, 1 for target domain). The global-alignment is achieved by the adversarial training between C D and (E, C seg , C cr ). Finally, our multi-scale consistent domain adaptation network is able to align domain shift at global scales, local-scale and pixel-scale simultaneously.
Similar to local-scale adaptation, we formulate the pixel-scale entropy loss as: t pix ), 0} (5) For multi-scale adaptation, we also use the same back-propagation optimizing scheme with the gradient reverse layer mentioned in [13,14]. The training objective can be express as: where L D is provided in supplementary materials; λ cr , λ ent and λ D are the weight factor to balance the unsupervised adaptation on target data and the task-specific objectives on source data.

Datasets
We evaluate our unsupervised domain adaptation networks for semantic segmentation on two challenging synthesized-to-real tasks: GTA5 [35] → Cityscapes [9] and SYNTHIA [36] → Cityscapes. GTA5 contains 24, 966 synthesized images with high-resolution and we use the 19 common categories between GTA5 and Cityscapes in the same setting as in [44]. SYNTHIA contains 9, 400 synthetic images with 16 common categories in Cityscapes. We use either GTA5 or SYN-THIA as source domain. We use the unlabelled training set of Cityscapes as target domain, which includes 2975 real-world images.

Implementation Details
For a fair comparison, similar to [49] [31] [44], we utilize Deeplab-V2 architecture [3] with ResNet-101 pretrained on ImageNet [10] as our single-scale semantic Table 1. Results of domain adaptation task GTA5 → Cityscapes. "V" means the VGG16-based model and "R" means the ResNet101-based model.  segmentation network (E + C seg ). To extend our model to multi-scale network, we simply copy and modify C seg to create C cr and C D with different output channels (e.g.,N and 1) and different output sizes due to various scales (i.e., region-size and global-size). We also apply our methods on VGG-16 [43] in the same way as employing ResNet-101. Following [13] [47], a gradient reverse layer is employed to reverse the entropy loss between E and (C seg , C cr ) during pixel-/region-scale adaptation to achieve adversarial training. The domain classifier C D works similar to a discriminator for global-scale alignment. During training, we utilize SGD [1] to optimize our networks with a momentum of 0.9 and a weight decay of 1e − 4. The initial learning rate is set as 2.5e − 4 and decayed by a polynomial policy with a power of 0.9, as illustrated in [3]. For all experiments, the hyper-parameters λ ent , λ D , λ cr and N are set as 2.5e − 5, 2.5e − 5, 5e − 3 and 100, respectively.

Comparison with state-of-art
We compare the experimental results of our method and state-of-the-art algorithms in two "Synthetic-to-real" UDA tasks with two different architectures: VGG-16 and ResNet-101. For "GTA5 → Cityscapes", we present the results in Table 1 with comparisons to the state-of-the-art domain adaptation methods [49,31,44,19,55,18,56,57]. Our contextual-relation consistent domain adaptation, expressed as CrCDA, achieves comparable performance to other stateof-the-art approaches on both architectures. Compared to Adapt-SegMap (output space global alignment) [44], category-level adversarial network (output space class-wise alignment) [31] and patch-represented global alignment [45] (patch-indexed latent space alignment), CrCDA consistently brings over +2.1% mIoU improvements on ResNet-101. We reckon this gain is from our end-toend/concurrent multi-scale alignment, which indicates that local consistency Table 2. Results of domain adaptation task SYNTHIA → Cityscapes. "V" means the VGG16-based model and "R" means the ResNet101-based model. "mIoU" and "mIoU*" are calculated over 16 and 13 classes, respectively.  Table 2, we present the adaptation result for the task "SYNTHIA → Cityscapes" and consistent improvements are observed w.r.t state-of-the-arts. Detailed analysis is included in next subsection.

Ablation Studies and Analysis
We analyze our proposed CrCDA with several state-of-the-art baselines. In general, both single-scale form (CrCDA * ) and multi-scale form (CrCDA) achieve comparable results to all the baselines in all the settings.
As shown on the first three rows in Table 3, our pixel-scale AEMM adversarial network brings +1.4% improvements in terms of mIoU over MinEnt [49]. The reason lies in that direct entropy minimization does not take the domain gap into account while our AEMM training scheme pushes the source distribution closer to target distribution during maximizing entropy on target data.
For our CrCDA with single-scale form (CrCDA * ) via AEMM, it outperforms MinEnt-based contextual-relations alignment by +1.6% on ResNet-101, as shown on the second block (row4-5) in Table 3. We reckon that these improvements are contributed by our adaptive entropy max-min training scheme which considers the domain mismatch/gap while MinEnt neglects.
Our CrCDA with multi-scale form integrating three scales' adaptation (pixel-, local-and global-scale), termed as CrCDA shown on the bottom block in Table 3, achieves state-of-the-art performances 48.6% mIoU on ResNet-101. Besides, CrCDA also outperforms all current methods by over +1.5%. Compared to "Pixel+Global", CrCDA brings +2.6% improvement in mIoU, which demonstrates that local-scale alignment is essential as well as other scales (e.g., pixelscale and global-scale). In fact, the local contextual-relation consistent adaptation loss (i.e., L ent cr ) penalize groups of pixels predictions to achieve local-scale Table 3. Ablation study of the proposed contextual-relation consistent domain adaptation on GTA5-to-Cityscapes using the ResNet-101 network. All settings/methods are with "Lseg" (bold texts represent our methods). CrCDA * represents the contextualrelation consistent domain adaptation with only single-scale (local scale).   [45] 43.2 CrCDA * + AdaptSeg [44] 44.8 CrCDA * + PatAlign [45] 44.7 CrCDA * + AdvEnt [49] 45.2 CrCDA * +GlobalAlign (ours) 46.1 alignment, where global-scale adaptation loss operates more on image-scale (e.g., scene layout) while that of pixel-scale works on the feature representation alignment of each independent pixels. The consistent results with different settings further confirm that complementary information has been learned in different scales' adaptation. The qualitative results and visualization of feature distributions are provided in Fig. 5 and 6, which further demonstrate our conjectures mentioned above. We also provide the complementary studies to demonstrate that our local contextual-relations alignment method is complementary to most existing global-scale alignment approaches, as shown in Table 4.

Conclusions
In this paper, we present the local contextual-relation consistent domain adaptation (CrCDA) to address the task of unsupervised domain adaptation for seman-  Fig. 6. Visualization of feature distributions via t-SNE [33]. "Blue": Source. "Red": Target. As shown in the first column, the feature distribution of source data is naturally more discriminative (discrete) than that of target data (uniformly distributed) due to only source supervision is available. Traditional global alignment (TGA) aligns them in global scale, where global consistency is achieved while local consistency is ignored. Thus the adapted target feature distribution is not discriminative. CrCDA aligns them with local-scale consistency (i.e., local contextual-relation consistency), where both local and global consistencies are achieved. Thus the adapted target feature distribution is more discriminative and consistent with that of the source.
tic segmentation. By taking a closer look at the local inconsistency (i.e., local contextual-relations inconsistency) while implementing global adaptation, Cr-CDA is able to align the domain shift in local and global scales at the same time, where local semantic consistency is normally ignored by current approaches. The experimental results on the two challenging segmentation UDA tasks validate the state-of-the-art of CrCDA.

Acknowledgement
This research was conducted in collaboration with Singapore Telecommunications Limited and partially supported by the Singapore Government through the Industry Alignment Fund -Industry Collaboration Projects Grant.

A. Appendix
A.1. Method -Details of region-scale/contextual-relation pseudo labels and regularizer weight We would share more details about the region-scale/contextual-relation pseudo labels and the weight of regularizer used in this paper. For the source domain, the sizes of the input image for datasets GTA5 and SYNTHIA are 720 × 1280 and 760 × 1280 , respectively. In this paper, we use two types of regions with two different sizes. The first sizes of regions for datasets GTA5 and SYNTHIA are 18 × 32 and 19 × 32, respectively. The second sizes of regions for datasets GTA5 and SYNTHIA are 36 × 64 and 38 × 64, respectively. For the target domain (dataset Cityscapes), the size of input image is 512 × 1024. The sizes of regions are 16×32 and 32×64, respectively. We use two independent contextual-relations (CR) classifiers to deal with these two types of regions with two different sizes.
The weight of the regularizer in adaptive entropy max-minimizing adversarial learning scheme decreases with training iteration, which is expressed as: λ R = (1 − iter max iter ) power with power = 0.9.

A.2. Method -Traditional Losses
For the source domain, traditional approaches learn a supervised segmentation model G that aims to minimize a segmentation loss. For the target domain, UDA networks using adversarial learning train G to extract domain-invariant features though the minimaxing game between G and a domain discriminator D. The overall loss in the UDA networks can therefore be formulated by: L(X s , X t ) = L seg (G) + L adv (G, D) A.3. Method -Loss in Multi-Scale Adaptation Source Flow: In our contextual-relation consistent domain adaptation (Cr-CDA) with multi-scale form, the source-domain data contribute to L seg , L cr and L D . Given a source-domain image x s ⊂ X s and the corresponding pixelscale label y s ⊂ Y s , region-scale (contextual-relations) pseudo label y s cr ⊂ Y s cr , P (h,w,c) s = C seg (E(x s )) is the predicted probability map w.r.t each pixel over C classes; P (i,j,n) s cr = C cr (E(x s )) is the predicted probability map w.r.t each region over N classes. The layout probability map P (h,w,c+n) s layout is generated by concatenating P Target Flow: As the target label is not accessible, we design an adversarial training scheme between feature extractor E and classifiers (C seg , C cr and C D ) that extracts discriminative features via max-minimizing entropy in the target domain. Given a target image x t ⊂ X t , P (h,w,c) t = C seg (E(x t )) is the predicted probability map w.r.t each target pixel over C classes; P (i,j,n) t cr = C cr (E(x t )) is the predicted probability map w.r.t each target region over N classes. The layout probability map P Therefore, the overall global alignment loss is expressed as: where domain classifier entropy is Ent s d = −C D (P

A.4. Experiment -More Qualitative Results
We share more qualitative experimental results for GTA5 → Cityscapes as shown in Fig. 7. As Fig. 7 shows, our CrCDA aligns both low-level features (e.g., boundaries of sidewalk, car and person etc.) and high-level features by multi-scale adversarial learning. As a comparison, AdvEnt neglects low-level information which focuses more on high-level features. As a result, CrCDA achieves both local and global consistencies in segmentation while AdvEnt achieves global consistency only. Qualitative results for GTA5 → Cityscapes. Our approach (CrCDA) aligns low-level features (e.g., boundaries of sidewalk, car and person etc.) as well as highlevel features by multi-scale adversarial learning. In contrast, AdvEnt ignores low-level information because global alignment focuses more on high-level information. Thus, as shown above, CrCDA achieves both local and global consistencies while AdvEnt only achieves global consistency.