Shaun Bailey, the Prime Minister's only black aide, was 'frozen out by David Cameron's clique' "They just didn't get what Shaun was saying," said one of Mr Bailey's friends last night. "He kept challenging them saying, 'Why are we not saying this?" ... He went into Downing Street and the first thing he said was, 'The only political conversation you need to have publicly is about the cost of living." He also gave plenty of warning that if they wanted to talk about being a diverse party, people have to see it. But they didn't want to hear about it. Shaun was frozen out. Shaun always says that you can see from space that the place is dominated by those from Eton. Mr Bailey, a father-of-two in his early 40s, has discussed his concerns with a number of Tory MPs. One has told him that there is a "class war" going on within the party. The disclosure will be damaging for Mr Cameron, who is already facing claims that he is running a "chumocracy" in Downing Street after he promoted several Old Etonians in recent weeks, including Jo Johnson, the brother of the London mayor Boris Johnson, and Jesse Norman. Mr Cameron was also educated at Eton, as was Ed Llewellyn, his chief of staff, Oliver Letwin, the Cabinet Office minister, and Sir George Young, the Chief Whip. Mr Bailey, who was paid a salary of £60,000 to advise the Prime Minister on youth, crime and race issues, is the first insider to raise concerns about the elite backgrounds of those in the inner core of No 10. His appointment after the 2010 general election was lauded as a sign of the inclusive nature of Mr Cameron's office, a view which took on particular importance after the summer riots of 2011. However, in January he was moved quietly to the Cabinet Office, becoming the Government's "youth and engagement champion." His appointment to the new position was not publicly announced. Mr Bailey is being paid substantially less for this part-time role - £36,000 a year - and is only on a one-year contract. He does not have his own desk or office, but a source in the Cabinet Office insisted that if he needed a seat he would be "accommodated." Last night, it was unclear what exactly Mr Bailey's new role involves. Mr Bailey, who stood unsuccessfully in Hammersmith, west London, as a Tory A-list candidate in the 2010 election, is understood to have clashed with colleagues and became so dispirited that he did not even turn up for work during one week last autumn. "It was very difficult for Shaun," one friend said. He was never included. He got the distinct impression they tried to keep him away from the Prime Minister. The friend added: "It got to a point where Shaun just stopped saying things because it was just getting him in trouble. There was even one week where he decided not to go into the office because he wanted to see if they would even notice. None of them. Mr Bailey is understood to have appealed directly to the Prime Minister, with whom he is understood to have no personal issues, over concerns that the party was not appealing to a "broader set." He is said to have been "horrified" when Frank Luntz, an American polling expert, visited Downing Street and addressed a group of advisers. The friend said: "The pollster asked them what kept them awake at night and they didn't even have the wit to understand that he meant it was the electorate. When the pollster pointed that out to them, they literally said, 'Nothing keeps us awake. How can you be advising people and nothing keeps you awake? Then someone said 'school fees."" Friends added yesterday: "Shaun believes that the bottom line is that him being of a different class is probably equally, if not more, important than him being black. For him being both of those things made him uniquely helpful. Mr Cameron has rejected claims that he is running a "clique" in Downing Street, and stressed that William Hague, the Foreign Secretary, and Patrick McLoughlin, the Transport Secretary, were educated at comprehensive schools. He said this month that he only appointed people "because I think they'll be good." Mr Bailey declined to comment. A Downing Street source said: "Shaun was a highly valued member of the No 10 team, and he is continuing that good work at the Cabinet Office."