In our experiments, we investigate RadTex's effectiveness in learning visual representations during pretraining and its downstream transfer efficiency compared to other models with the same encoder architecture: randomly initialized ResNet-50, ImageNet-pretrained [1]}, and ChestX-ray14-pretrained [2]}, [3]} (CXR14).
