With the new government in power in late 2003, he was appointed Minister of Internal Affairs of Georgia.

He was seen as a member of the government faction grouped around the then Prime Minister (and Rose Revolution leader) Zurab Zhvania that were seen to be in opposition to the President Mikheil Saakashvili.
As such he publicly cast doubt upon the official explanation for Zhvania's death due to carbon monoxide poisoning and instead appeared to endorse the possibility of foul play stating "none of the versions [of explanation for his death] should be ruled out."

In June 2004, he was appointed Minister of Defense replacing Gela Bezhuashvili.
In December 2004, some sixty servicemen went AWOL and rallied outside the Human Rights Ombudsman’s Office to demand better social conditions in the army.
The former military Ombudsman, Irakli Sesiashvili said that while Baramidze was in charge "these soldiers have not taken a bath for two months; there is not enough food.
Over the last two months, they have eaten meat only a few times.
The soldiers do not even have cold water regularly.
Heating equipment has been installed, but there is no fuel… all of these Ministers care more about repairing their offices and purchasing new jeeps."

In December 2004, he was moved to the post of Vice Premier and State Minister for Euro-Atlantic Integration.
With the new government in power in late 2003, he was appointed Minister of Internal Affairs of Georgia.
He was seen as a member of the government faction grouped around the then Prime Minister (and Rose Revolution leader) Zurab Zhvania that were seen to be in opposition to the President Mikheil Saakashvili. As such he publicly cast doubt upon the official explanation for Zhvania's death due to carbon monoxide poisoning and instead appeared to endorse the possibility of foul play stating "none of the versions [of explanation for his death] should be ruled out."
In June 2004, he was appointed Minister of Defense replacing Gela Bezhuashvili. In December 2004, some sixty servicemen went AWOL and rallied outside the Human Rights Ombudsman’s Office to demand better social conditions in the army. The former military Ombudsman, Irakli Sesiashvili said that while Baramidze was in charge "these soldiers have not taken a bath for two months; there is not enough food. Over the last two months, they have eaten meat only a few times. The soldiers do not even have cold water regularly. Heating equipment has been installed, but there is no fuel… all of these Ministers care more about repairing their offices and purchasing new jeeps."
In December 2004, he was moved to the post of Vice Premier and State Minister for Euro-Atlantic Integration.
Giorgi Baramidze