First, our system significantly outperforms the crowd when the crowd's predictions express high uncertainty. Specifically, when the crowd's predictions are between.3 and.7, our Brier score is.199 compared to the crowd's.246. However, our system underperforms the crowd on questions where they are highly certain, likely because it rarely outputs low probabilities (Figure 3(b)). We hypothesize that this stems from our model's tendency to hedge predictions due to its safety training (see Figure 17 for a qualitative example). Supporting this, our system achieves 7% higher accuracy on questions where the crowd's prediction is within.05 of 0 or 1, but the Brier score is worse by.04.