Update README.md
Browse files
README.md
CHANGED
@@ -92,10 +92,10 @@ pipeline_tag: image-segmentation
|
|
92 |
|
93 |
<div style="border:1px solid black; padding:25px; background-color:#FDFFF4 ; padding-top:10px; padding-bottom:1px;">
|
94 |
<h1>FLAIR-INC_rgbie_15cl_resnet34-unet</h1>
|
95 |
-
<p>The general characteristics of this specific model <strong>FLAIR-
|
96 |
<ul style="list-style-type:disc;">
|
97 |
<li>Trained with the FLAIR-INC dataset</li>
|
98 |
-
<li>
|
99 |
<li>U-Net with a Resnet-34 encoder</li>
|
100 |
<li>15 class nomenclature : [building, pervious surface, impervious surface, bare soil, water, coniferous, deciduous, brushwood, vineyard, herbaceous, agricultural land, plowed land, swimming pool, snow, greenhouse]</li>
|
101 |
</ul>
|
@@ -126,11 +126,6 @@ _**Multi-domain model**_ :
|
|
126 |
The FLAIR-INC dataset that was used for training is composed of 75 radiometric domains. In the case of aerial images, domain shifts are frequent and are mainly due to : the date of acquisition of the aerial survey (from april to november), the spatial domain (equivalent to a french department administrative division) and downstream radiometric processing.
|
127 |
By construction (sampling 75 domains) the model is robust to these shifts, and can be applied to any images of the ([BD ORTHO® product](https://geoservices.ign.fr/bdortho)).
|
128 |
|
129 |
-
_**Specification for the Elevation channel**_ :
|
130 |
-
The fifth dimension of the RGBIE images is the Elevation (height of building and vegetation). This information is encoded in a 8-bit encoding format.
|
131 |
-
When decoded to [0,255] ints, a difference of 1 should coresponds to 0.2 meters step of elevation difference.
|
132 |
-
|
133 |
-
|
134 |
_**Land Cover classes of prediction**_ :
|
135 |
The orginial class nomenclature of the FLAIR Dataset encompasses 19 classes (See the [FLAIR dataset](https://huggingface.co/datasets/IGNF/FLAIR) page for details).
|
136 |
However 3 classes corresponding to uncertain labelisation (Mixed (16), Ligneous (17) and Other (19)) and 1 class with very poor labelling (Clear cut (15)) were desactivated during training.
|
@@ -141,15 +136,15 @@ As a result, the logits produced by the model are of size 19x1, but classes n°
|
|
141 |
## Bias, Risks, Limitations and Recommendations
|
142 |
|
143 |
_**Using the model on input images with other spatial resolution**_ :
|
144 |
-
The FLAIR-
|
145 |
No data augmentation method concerning scale change was used during training. The user should pay attention that generalization issues can occur while applying this model to images that have different spatial resolutions.
|
146 |
|
147 |
_**Using the model for other remote sensing sensors**_ :
|
148 |
-
The FLAIR-
|
149 |
Using the model on other type of aerial images or satellite images may imply the use of transfer learning or domain adaptation techniques.
|
150 |
|
151 |
_**Using the model on other spatial areas**_ :
|
152 |
-
The
|
153 |
The user should be aware that applying the model to other type of landscapes may imply a drop in model metrics.
|
154 |
|
155 |
---
|
@@ -192,7 +187,6 @@ Statistics of the TRAIN+VALIDATION set :
|
|
192 |
| Green Channel (G) | 110.87 |45.38 |
|
193 |
| Blue Channel (B) | 101.82 |44.00 |
|
194 |
| Infrared Channel (I) | 106.38 |39.69 |
|
195 |
-
| Elevation Channel (E) | 53.26 |79.30 |
|
196 |
|
197 |
|
198 |
#### Training Hyperparameters
|
@@ -204,8 +198,8 @@ Statistics of the TRAIN+VALIDATION set :
|
|
204 |
* HorizontalFlip(p=0.5)
|
205 |
* RandomRotate90(p=0.5)
|
206 |
* Input normalization (mean=0 | std=1):
|
207 |
-
* norm_means: [105.08, 110.87, 101.82, 106.38
|
208 |
-
* norm_stds: [52.17, 45.38, 44, 39.69
|
209 |
* Seed: 2022
|
210 |
* Batch size: 10
|
211 |
* Number of epochs : 200
|
|
|
92 |
|
93 |
<div style="border:1px solid black; padding:25px; background-color:#FDFFF4 ; padding-top:10px; padding-bottom:1px;">
|
94 |
<h1>FLAIR-INC_rgbie_15cl_resnet34-unet</h1>
|
95 |
+
<p>The general characteristics of this specific model <strong>FLAIR-INC_rgbi_15cl_resnet34-unet</strong> are :</p>
|
96 |
<ul style="list-style-type:disc;">
|
97 |
<li>Trained with the FLAIR-INC dataset</li>
|
98 |
+
<li>RGBI images (true colours + infrared )</li>
|
99 |
<li>U-Net with a Resnet-34 encoder</li>
|
100 |
<li>15 class nomenclature : [building, pervious surface, impervious surface, bare soil, water, coniferous, deciduous, brushwood, vineyard, herbaceous, agricultural land, plowed land, swimming pool, snow, greenhouse]</li>
|
101 |
</ul>
|
|
|
126 |
The FLAIR-INC dataset that was used for training is composed of 75 radiometric domains. In the case of aerial images, domain shifts are frequent and are mainly due to : the date of acquisition of the aerial survey (from april to november), the spatial domain (equivalent to a french department administrative division) and downstream radiometric processing.
|
127 |
By construction (sampling 75 domains) the model is robust to these shifts, and can be applied to any images of the ([BD ORTHO® product](https://geoservices.ign.fr/bdortho)).
|
128 |
|
|
|
|
|
|
|
|
|
|
|
129 |
_**Land Cover classes of prediction**_ :
|
130 |
The orginial class nomenclature of the FLAIR Dataset encompasses 19 classes (See the [FLAIR dataset](https://huggingface.co/datasets/IGNF/FLAIR) page for details).
|
131 |
However 3 classes corresponding to uncertain labelisation (Mixed (16), Ligneous (17) and Other (19)) and 1 class with very poor labelling (Clear cut (15)) were desactivated during training.
|
|
|
136 |
## Bias, Risks, Limitations and Recommendations
|
137 |
|
138 |
_**Using the model on input images with other spatial resolution**_ :
|
139 |
+
The FLAIR-INC_rgbi_15cl_resnet34-unet model was trained with fixed scale conditions. All patches used for training are derived from aerial images with 0.2 meters spatial resolution. Only flip and rotate augmentations were performed during the training process.
|
140 |
No data augmentation method concerning scale change was used during training. The user should pay attention that generalization issues can occur while applying this model to images that have different spatial resolutions.
|
141 |
|
142 |
_**Using the model for other remote sensing sensors**_ :
|
143 |
+
The FLAIR-INC_rgbi_15cl_resnet34-unet model was trained with aerial images of the ([BD ORTHO® product](https://geoservices.ign.fr/bdortho)) that encopass very specific radiometric image processing.
|
144 |
Using the model on other type of aerial images or satellite images may imply the use of transfer learning or domain adaptation techniques.
|
145 |
|
146 |
_**Using the model on other spatial areas**_ :
|
147 |
+
The FFLAIR-INC_rgbi_15cl_resnet34-unet model was trained on patches reprensenting the French Metropolitan territory.
|
148 |
The user should be aware that applying the model to other type of landscapes may imply a drop in model metrics.
|
149 |
|
150 |
---
|
|
|
187 |
| Green Channel (G) | 110.87 |45.38 |
|
188 |
| Blue Channel (B) | 101.82 |44.00 |
|
189 |
| Infrared Channel (I) | 106.38 |39.69 |
|
|
|
190 |
|
191 |
|
192 |
#### Training Hyperparameters
|
|
|
198 |
* HorizontalFlip(p=0.5)
|
199 |
* RandomRotate90(p=0.5)
|
200 |
* Input normalization (mean=0 | std=1):
|
201 |
+
* norm_means: [105.08, 110.87, 101.82, 106.38]
|
202 |
+
* norm_stds: [52.17, 45.38, 44, 39.69]
|
203 |
* Seed: 2022
|
204 |
* Batch size: 10
|
205 |
* Number of epochs : 200
|