ure 4, we redo this calculation for different model sizes and we see that _overall_ efficiency gain increases with model size. Based on this, we can conservatively estimate that D4 would have overall efficiency gains of 20% for LLama-65B [50] and 22% for OPT-175B [59].