While in Washington , Lead Belly encountered several other incidents of segregation that are believed to have contributed to the impetus of the song . For instance , when Lead Belly , Lomax , and their wives wanted to go out to dinner together , they discovered that it was impossible for the mixed race group to find a restaurant that would serve them . Lead Belly was told that if he returned later without Lomax , he would be served .