Current White Population demographics in Silverton, Texas 2016, 2015 by gender and age. 1  Total White population in Silverton. 2  Median age of White in Silverton. 3  Population of White in households in Silverton. 4  Average White household size in Silverton. 5  Number of White occupied homes in Silverton.