Place wards around his jungle entrances to spot him leaving his jungle. Grouping against Graves will prevent him from taking down key targets in team fights because he will struggle to get through multiple champions at once.