<jupyter_start><jupyter_text>Super classing Long-Tailed Dataset🥁 Day 1: Super classing Long-Tailed Datasets.When we combine classes together and classify them individually first, we are reducing the effective imbalance factor of the entire dataset. From 100 classes to 10 classes. Would that help?&mdash; <NAME> (@lettucelemontea) March 7, 2022<jupyter_code>!git clone <I will make this repo public soon>
!pip install -r LibLongTail/requirements.txt 
%cd LibLongTail/
import wandb
wandb.login()
!python run.py --sub_exp "Baseline_CE" --cfg "/content/LibLongTail/configs/classification/CIFAR100LT/ce.yaml" --opts LOGGER.PROJECT_NAME "100DaysOfDL" GENERAL.EPOCH 100 GENERAL.GPUS [0] ARCH.BACKBONE "resnet18" DATASET.IMB 0.005
!python run.py --sub_exp "Baseline_cRT" --cfg "/content/LibLongTail/configs/classification/CIFAR100LT/crt.yaml" --opts LOGGER.PROJECT_NAME "100DaysOfDL" GENERAL.EPOCH 100 GENERAL.GPUS [0] ARCH.BACKBONE "resnet18" DATASET.IMB 0.005 ARCH.PRETRAIN "/content/LibLongTail/logs/seed_1/cifar100lt/resnet18/ce/Baseline_CE_ce_cifar100lt_resnet18_seed_1_imb_0.005/best.ckpt"
!python run.py --sub_exp "supclass_stage1" --cfg "/content/LibLongTail/configs/classification/CIFAR100LT/ce.yaml" --opts LOGGER.PROJECT_NAME "100DaysOfDL" GENERAL.EPOCH 100 GENERAL.GPUS [0] ARCH.BACKBONE "resnet18" DATASET.IMB 0.005 DATASET.NUM_CLS 20
!python run.py --sub_exp "supclass_stage2_corrected" --cfg "/content/LibLongTail/configs/classification/CIFAR100LT/crt.yaml" --opts LOGGER.PROJECT_NAME "100DaysOfDL" GENERAL.EPOCH 100 GENERAL.GPUS [0] ARCH.BACKBONE "resnet18" DATASET.IMB 0.005 ARCH.PRETRAIN "/content/LibLongTail/logs/seed_1/cifar100lt/resnet18/ce/supclass_stage1_ce_cifar100lt_resnet18_seed_1_imb_0.005/best.ckpt"<jupyter_output>Global seed set to 1
Using downloaded and verified file: datasets/CIFAR100_LT/val.pth
Using downloaded and verified file: datasets/CIFAR100_LT/test.pth
Using downloaded and verified file: datasets/CIFAR100_LT/train_imb_200.pth
Files already downloaded and verified
Using 16bit native Automatic Mixed Precision (AMP)
GPU available: True, used: True
TPU available: False, using: 0 TPU cores
IPU available: False, using: 0 IPUs
Global seed set to 1
initializing distributed: GLOBAL_RANK: 0, MEMBER: 1/1
----------------------------------------------------------------------------------------------------
distributed_backend=nccl
All distributed processes registered. Starting with 1 processes
----------------------------------------------------------------------------------------------------

Files already downloaded and verified
Files already downloaded and verified
LOCAL_RANK: 0 - CUDA_VISIBLE_DEVICES: [0]
[34m[1mwandb[0m: Currently logged in as: [33mrahulvigneswaran[0m (use `wandb login --[...]
{'fraction_non_alphanumeric': 0.16259569814072183, 'fraction_numerical': 0.052132701421800945, 'mean_word_length': 3.8309859154929575, 'pattern_counts': {'":': 0, '<': 6, '<?xml version=': 0, '>': 6, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 6, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'chain_length': '1', 'dir': 'jupyter-structured-clean-dedup', 'id': '501396', 'license': 'MIT', 'n_tokens_mistral': 1034, 'n_tokens_neox': 908, 'n_words': 230, 'path': 'Day_1_SuperClassingLT.ipynb', 'repo_name': 'rahulvigneswaran/100DaysOfDeepLearning', 'size': '2754'}