Martin Tomov commited on
Commit
48c6466
1 Parent(s): b142f13

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +13 -17
README.md CHANGED
@@ -1,26 +1,22 @@
1
  ---
2
  license: apache-2.0
3
- pinned: true
4
  ---
5
 
6
  # InsectSAM: Insect Segmentation and Monitoring
7
 
8
- <p align="left">
9
- <a href="" rel="noopener">
10
- <img width=200px height=200px src="https://i.imgur.com/hjWgAN9.png alt="Project logo"></a>
11
- </p>
12
 
13
  ## Overview
14
 
15
- InsectSAM is an advanced machine learning model tailored for the https://diopsis.eu camera systems and https://www.arise-biodiversity.nl/, dedicated to Insect Biodiversity Detection and Monitoring in the Netherlands. Built on Meta AI's `segment-anything` model, InsectSAM is fine-tuned to be accurate at segmenting insects from complex backgrounds, enhancing the accuracy and efficiency of biodiversity monitoring efforts.
16
 
17
  ## Purpose
18
 
19
- This model has been meticulously trained to identify and segment insects against a variety of backgrounds that might otherwise confuse traditional algorithms. It is specifically designed to adapt to future changes in background environments, ensuring its long-term utility in the DIOPSIS / ARISE project.
20
 
21
  ## Model Architecture
22
 
23
- InsectSAM utilizes the advanced capabilities of the `segment-anything` architecture, enhanced by our custom training on an insect-centric dataset. The model is further refined by integrating with GroundingDINO, improving its ability to distinguish fine details and subtle variations in insect appearances.
24
 
25
  ## Quick Start
26
 
@@ -33,12 +29,13 @@ InsectSAM utilizes the advanced capabilities of the `segment-anything` architect
33
  ### Usage
34
 
35
  #### Install
36
- ``` bash
37
  !pip install --upgrade -q git+https://github.com/huggingface/transformers
38
  !pip install torch
39
  ```
40
- #### Load model directly via HF Transformers 🤗
41
- ``` bash
 
42
  from transformers import AutoProcessor, AutoModelForMaskGeneration
43
 
44
  processor = AutoProcessor.from_pretrained("martintmv/InsectSAM")
@@ -47,10 +44,9 @@ model = AutoModelForMaskGeneration.from_pretrained("martintmv/InsectSAM")
47
 
48
  ### Notebooks
49
 
50
- Three Jupyter notebooks are provided to demonstrate the model's capabilities and its integration with GroundingDINO:
51
-
52
- - **InsectSAM.ipynb**: Covers the training process, from data preparation to model evaluation.
53
- - **InsectSAM_GroundingDINO.ipynb**: Demonstrates how InsectSAM is combined with GroundingDINO for enhanced segmentation performance.
54
- - **Run_InsectSAM_Inference_Transformers.ipynb**: Run InsectSAM using Transformers.
55
 
56
- Check out the notebooks on RB-IBDM's GitHub page - https://github.com/martintmv-git/RB-IBDM/tree/main/InsectSAM
 
1
  ---
2
  license: apache-2.0
 
3
  ---
4
 
5
  # InsectSAM: Insect Segmentation and Monitoring
6
 
7
+ ![rb-ibdm-banner](https://github.com/martintmv-git/RB-IBDM/assets/101264514/a22f2069-e3c8-4a4f-a314-59cb01b39b66)
 
 
 
8
 
9
  ## Overview
10
 
11
+ InsectSAM is a fine-tuned version of Meta AI's `segment-anything` model, optimized for insect segmentation and monitoring in the Netherlands. Designed for use with the [DIOPSIS](https://diopsis.eu) camera systems, algorithms and datasets, it enhances the accuracy of insect biodiversity segmentation from complex backgrounds.
12
 
13
  ## Purpose
14
 
15
+ Trained to segment insects against diverse backgrounds, InsectSAM adapts to changing environments, ensuring its long-term utility for the DIOPSIS datasets.
16
 
17
  ## Model Architecture
18
 
19
+ Built on the `segment-anything` architecture, InsectSAM is fine-tuned on an insect-specific dataset and integrated with GroundingDINO for improved detail recognition.
20
 
21
  ## Quick Start
22
 
 
29
  ### Usage
30
 
31
  #### Install
32
+ ```bash
33
  !pip install --upgrade -q git+https://github.com/huggingface/transformers
34
  !pip install torch
35
  ```
36
+
37
+ #### Load model via 🤗 Transformers
38
+ ```python
39
  from transformers import AutoProcessor, AutoModelForMaskGeneration
40
 
41
  processor = AutoProcessor.from_pretrained("martintmv/InsectSAM")
 
44
 
45
  ### Notebooks
46
 
47
+ Explore InsectSAM's capabilities and integration with GroundingDINO through three Jupyter notebooks available on the RB-IBDM GitHub page:
48
+ - [**InsectSAM.ipynb**](https://github.com/martintmv-git/RB-IBDM/blob/main/InsectSAM/InsectSAM.ipynb): Training process
49
+ - [**InsectSAM_GroundingDINO.ipynb**](https://github.com/martintmv-git/RB-IBDM/blob/main/InsectSAM/InsectSAM_GroundingDINO.ipynb): Enhanced segmentation performance with GroundingDINO
50
+ - [**InsectSAM_script.ipynb**](https://github.com/martintmv-git/RB-IBDM/tree/main/Image%20Processing%20Scripts/InsectSAM): Image processing script
 
51
 
52
+ GitHub: https://github.com/martintmv-git/RB-IBDM/tree/main/InsectSAM