ayoubkirouane
commited on
Commit
•
141ed30
1
Parent(s):
a61bc67
Update README.md
Browse files
README.md
CHANGED
@@ -13,4 +13,60 @@ license: other
|
|
13 |
language:
|
14 |
- en
|
15 |
library_name: transformers
|
16 |
-
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
13 |
language:
|
14 |
- en
|
15 |
library_name: transformers
|
16 |
+
---
|
17 |
+
|
18 |
+
|
19 |
+
## Model Details
|
20 |
+
|
21 |
+
+ **Model Name**: Segments-Sidewalk-SegFormer-B0
|
22 |
+
+ **Model Type**: Semantic Segmentation
|
23 |
+
+ **Base Model**: nvidia/segformer-b0-finetuned-ade-512-512
|
24 |
+
+ **Fine-Tuning Dataset**: Sidewalk-Semantic
|
25 |
+
|
26 |
+
## Model Description
|
27 |
+
|
28 |
+
The **Segments-Sidewalk-SegFormer-B0** model is a semantic segmentation model fine-tuned on the **sidewalk-semantic** dataset. It is based on the **SegFormer (b0-sized)** architecture and has been adapted for the task of segmenting sidewalk images into various classes, such as road surfaces, pedestrians, vehicles, and more.
|
29 |
+
|
30 |
+
## Model Architecture
|
31 |
+
|
32 |
+
The model architecture is based on SegFormer, which utilizes a **hierarchical Transformer Encoder and a lightweight all-MLP decoder head**. This architecture has been proven effective in semantic segmentation tasks, and fine-tuning on the 'sidewalk-semantic' dataset allows it to learn to segment sidewalk images accurately.
|
33 |
+
|
34 |
+
## Intended Uses
|
35 |
+
|
36 |
+
The **Segments-Sidewalk-SegFormer-B0** model can be used for various applications in the context of sidewalk image analysis and understanding.
|
37 |
+
|
38 |
+
**Some of the intended use cases include**
|
39 |
+
|
40 |
+
+ **Semantic Segmentation**: Use the model to perform pixel-level classification of sidewalk images, enabling the identification of different objects and features in the images, such as road surfaces, pedestrians, vehicles, and construction elements.
|
41 |
+
+ **Urban Planning**: The model can assist in urban planning tasks by providing detailed information about sidewalk infrastructure, helping city planners make informed decisions.
|
42 |
+
+ **Autonomous Navigation**: Deploy the model in autonomous vehicles or robots to enhance their understanding of the sidewalk environment, aiding in safe navigation.
|
43 |
+
|
44 |
+
|
45 |
+
![image/png](https://cdn-uploads.huggingface.co/production/uploads/6338c06c107c4835a05699f9/SwkCdzC8BektDh5wYA6Sl.png)
|
46 |
+
|
47 |
+
## Limitations
|
48 |
+
|
49 |
+
+ **Resolution Dependency**: The model's performance may be sensitive to the resolution of the input images. Fine-tuning was performed at a specific resolution, so using significantly different resolutions may require additional adjustments.
|
50 |
+
+ **Hardware Requirements**: Inference with deep learning models can be computationally intensive, requiring access to GPUs or other specialized hardware for real-time or efficient processing.
|
51 |
+
|
52 |
+
|
53 |
+
## Ethical Considerations
|
54 |
+
|
55 |
+
When using and deploying the **Segments-Sidewalk-SegFormer-B0** model, consider the following ethical considerations:
|
56 |
+
|
57 |
+
+ **Bias and Fairness**: Carefully evaluate the dataset for biases that may be present and address them to avoid unfair or discriminatory outcomes in predictions, especially when dealing with human-related classes (e.g., pedestrians).
|
58 |
+
+ **Privacy**: Be mindful of privacy concerns when processing sidewalk images, as they may contain personally identifiable information or capture private locations. Appropriate data anonymization and consent mechanisms should be in place.
|
59 |
+
+ **Transparency**: Clearly communicate the model's capabilities and limitations to end-users and stakeholders, ensuring they understand the model's potential errors and uncertainties.
|
60 |
+
+ **Regulatory Compliance**: Adhere to local and national regulations regarding the collection and processing of sidewalk images, especially if the data involves public spaces or private property.
|
61 |
+
+ **Accessibility**: Ensure that the model's outputs and applications are accessible to individuals with disabilities and do not exclude any user group.
|
62 |
+
|
63 |
+
## Usage
|
64 |
+
|
65 |
+
|
66 |
+
```python
|
67 |
+
# Load model directly
|
68 |
+
from transformers import AutoFeatureExtractor, SegformerForSemanticSegmentation
|
69 |
+
|
70 |
+
extractor = AutoFeatureExtractor.from_pretrained("ayoubkirouane/Segments-Sidewalk-SegFormer-B0")
|
71 |
+
model = SegformerForSemanticSegmentation.from_pretrained("ayoubkirouane/Segments-Sidewalk-SegFormer-B0")
|
72 |
+
```
|