There were only a few large-scale protests; the most remarkable was the Castle Hill Rising among Irish convicts outside Sydney in March 1804.
The impact of such a large convict population was less grim and ugly than might be expected.