The New York State attorney general, Eric T. Schneiderman, acting just days after the state began allowing gay couples to wed, filed a legal brief on Tuesday challenging the constitutionality of the federal Defense of Marriage Act.