Collections: - Name: Mask2Former Metadata: Training Data: COCO Training Techniques: - AdamW - Weight Decay Training Resources: 8x A100 GPUs Architecture: - Mask2Former Paper: URL: https://arxiv.org/pdf/2112.01527 Title: 'Masked-attention Mask Transformer for Universal Image Segmentation' README: configs/mask2former/README.md Code: URL: https://github.com/open-mmlab/mmdetection/blob/v2.23.0/mmdet/models/detectors/mask2former.py#L7 Version: v2.23.0 Models: - Name: mask2former_swin-s-p4-w7-224_lsj_8x2_50e_coco-panoptic In Collection: Mask2Former Config: configs/mask2former/mask2former_swin-s-p4-w7-224_lsj_8x2_50e_coco-panoptic.py Metadata: Training Memory (GB): 19.1 Iterations: 368750 Results: - Task: Object Detection Dataset: COCO Metrics: box AP: 47.8 - Task: Instance Segmentation Dataset: COCO Metrics: mask AP: 44.5 - Task: Panoptic Segmentation Dataset: COCO Metrics: PQ: 54.5 Weights: https://download.openmmlab.com/mmdetection/v2.0/mask2former/mask2former_swin-s-p4-w7-224_lsj_8x2_50e_coco-panoptic/mask2former_swin-s-p4-w7-224_lsj_8x2_50e_coco-panoptic_20220329_225200-c7b94355.pth - Name: mask2former_r101_lsj_8x2_50e_coco In Collection: Mask2Former Config: configs/mask2former/mask2former_r101_lsj_8x2_50e_coco.py Metadata: Training Memory (GB): 15.5 Iterations: 368750 Results: - Task: Object Detection Dataset: COCO Metrics: box AP: 46.7 - Task: Instance Segmentation Dataset: COCO Metrics: mask AP: 44.0 Weights: https://download.openmmlab.com/mmdetection/v2.0/mask2former/mask2former_r101_lsj_8x2_50e_coco/mask2former_r101_lsj_8x2_50e_coco_20220426_100250-c50b6fa6.pth - Name: mask2former_r101_lsj_8x2_50e_coco-panoptic In Collection: Mask2Former Config: configs/mask2former/mask2former_r101_lsj_8x2_50e_coco-panoptic.py Metadata: Training Memory (GB): 16.1 Iterations: 368750 Results: - Task: Object Detection Dataset: COCO Metrics: box AP: 45.3 - Task: Instance Segmentation Dataset: COCO Metrics: mask AP: 42.4 - Task: Panoptic Segmentation Dataset: COCO Metrics: PQ: 52.4 Weights: https://download.openmmlab.com/mmdetection/v2.0/mask2former/mask2former_r101_lsj_8x2_50e_coco-panoptic/mask2former_r101_lsj_8x2_50e_coco-panoptic_20220329_225104-c54e64c9.pth - Name: mask2former_r50_lsj_8x2_50e_coco-panoptic In Collection: Mask2Former Config: configs/mask2former/mask2former_r50_lsj_8x2_50e_coco-panoptic.py Metadata: Training Memory (GB): 13.9 Iterations: 368750 Results: - Task: Object Detection Dataset: COCO Metrics: box AP: 44.8 - Task: Instance Segmentation Dataset: COCO Metrics: mask AP: 41.9 - Task: Panoptic Segmentation Dataset: COCO Metrics: PQ: 51.9 Weights: https://download.openmmlab.com/mmdetection/v2.0/mask2former/mask2former_r50_lsj_8x2_50e_coco-panoptic/mask2former_r50_lsj_8x2_50e_coco-panoptic_20220326_224516-11a44721.pth - Name: mask2former_swin-t-p4-w7-224_lsj_8x2_50e_coco-panoptic In Collection: Mask2Former Config: configs/mask2former/mask2former_swin-t-p4-w7-224_lsj_8x2_50e_coco-panoptic.py Metadata: Training Memory (GB): 15.9 Iterations: 368750 Results: - Task: Object Detection Dataset: COCO Metrics: box AP: 46.3 - Task: Instance Segmentation Dataset: COCO Metrics: mask AP: 43.4 - Task: Panoptic Segmentation Dataset: COCO Metrics: PQ: 53.4 Weights: https://download.openmmlab.com/mmdetection/v2.0/mask2former/mask2former_swin-t-p4-w7-224_lsj_8x2_50e_coco-panoptic/mask2former_swin-t-p4-w7-224_lsj_8x2_50e_coco-panoptic_20220326_224553-fc567107.pth - Name: mask2former_r50_lsj_8x2_50e_coco In Collection: Mask2Former Config: configs/mask2former/mask2former_r50_lsj_8x2_50e_coco.py Metadata: Training Memory (GB): 13.7 Iterations: 368750 Results: - Task: Object Detection Dataset: COCO Metrics: box AP: 45.7 - Task: Instance Segmentation Dataset: COCO Metrics: mask AP: 42.9 Weights: https://download.openmmlab.com/mmdetection/v2.0/mask2former/mask2former_r50_lsj_8x2_50e_coco/mask2former_r50_lsj_8x2_50e_coco_20220506_191028-8e96e88b.pth - Name: mask2former_swin-l-p4-w12-384-in21k_lsj_16x1_100e_coco-panoptic In Collection: Mask2Former Config: configs/mask2former/mask2former_swin-l-p4-w12-384-in21k_lsj_16x1_100e_coco-panoptic.py Metadata: Training Memory (GB): 21.1 Iterations: 737500 Results: - Task: Object Detection Dataset: COCO Metrics: box AP: 52.2 - Task: Instance Segmentation Dataset: COCO Metrics: mask AP: 48.5 - Task: Panoptic Segmentation Dataset: COCO Metrics: PQ: 57.6 Weights: https://download.openmmlab.com/mmdetection/v2.0/mask2former/mask2former_swin-l-p4-w12-384-in21k_lsj_16x1_100e_coco-panoptic/mask2former_swin-l-p4-w12-384-in21k_lsj_16x1_100e_coco-panoptic_20220407_104949-d4919c44.pth - Name: mask2former_swin-b-p4-w12-384-in21k_lsj_8x2_50e_coco-panoptic In Collection: Mask2Former Config: configs/mask2former/mask2former_swin-b-p4-w12-384-in21k_lsj_8x2_50e_coco-panoptic.py Metadata: Training Memory (GB): 25.8 Iterations: 368750 Results: - Task: Object Detection Dataset: COCO Metrics: box AP: 50.0 - Task: Instance Segmentation Dataset: COCO Metrics: mask AP: 46.3 - Task: Panoptic Segmentation Dataset: COCO Metrics: PQ: 56.3 Weights: https://download.openmmlab.com/mmdetection/v2.0/mask2former/mask2former_swin-b-p4-w12-384-in21k_lsj_8x2_50e_coco-panoptic/mask2former_swin-b-p4-w12-384-in21k_lsj_8x2_50e_coco-panoptic_20220329_230021-3bb8b482.pth - Name: mask2former_swin-b-p4-w12-384_lsj_8x2_50e_coco-panoptic In Collection: Mask2Former Config: configs/mask2former/mask2former_swin-b-p4-w12-384_lsj_8x2_50e_coco-panoptic.py Metadata: Training Memory (GB): 26.0 Iterations: 368750 Results: - Task: Object Detection Dataset: COCO Metrics: box AP: 48.2 - Task: Instance Segmentation Dataset: COCO Metrics: mask AP: 44.9 - Task: Panoptic Segmentation Dataset: COCO Metrics: PQ: 55.1 Weights: https://download.openmmlab.com/mmdetection/v2.0/mask2former/mask2former_swin-b-p4-w12-384_lsj_8x2_50e_coco-panoptic/mask2former_swin-b-p4-w12-384_lsj_8x2_50e_coco-panoptic_20220331_002244-c149a9e9.pth - Name: mask2former_swin-t-p4-w7-224_lsj_8x2_50e_coco In Collection: Mask2Former Config: configs/mask2former/mask2former_swin-t-p4-w7-224_lsj_8x2_50e_coco.py Metadata: Training Memory (GB): 15.3 Iterations: 368750 Results: - Task: Object Detection Dataset: COCO Metrics: box AP: 47.7 - Task: Instance Segmentation Dataset: COCO Metrics: mask AP: 44.7 Weights: https://download.openmmlab.com/mmdetection/v2.0/mask2former/mask2former_swin-t-p4-w7-224_lsj_8x2_50e_coco/mask2former_swin-t-p4-w7-224_lsj_8x2_50e_coco_20220508_091649-4a943037.pth - Name: mask2former_swin-s-p4-w7-224_lsj_8x2_50e_coco In Collection: Mask2Former Config: configs/mask2former/mask2former_swin-s-p4-w7-224_lsj_8x2_50e_coco.py Metadata: Training Memory (GB): 18.8 Iterations: 368750 Results: - Task: Object Detection Dataset: COCO Metrics: box AP: 49.3 - Task: Instance Segmentation Dataset: COCO Metrics: mask AP: 46.1 Weights: https://download.openmmlab.com/mmdetection/v2.0/mask2former/mask2former_swin-s-p4-w7-224_lsj_8x2_50e_coco/mask2former_swin-s-p4-w7-224_lsj_8x2_50e_coco_20220504_001756-743b7d99.pth