In this photo provided by the U.S. Navy, an FBI evidence response team vehicle is parked outside Building 197 at the Navy Yard in Washington as evidence is collected Wednesday, Sept. A gunman killed 12 people at the base on Monday, Sept. AP Photo/U.S. Navy, Mass Communication Specialist 2nd Class Pedro A. Rodriguez Bishops Gerald Seabrooks, right, and Willie Billips speak to reporters after Cathleen Alexis, mother of Washington Navy Yard gunman Aaron Alexis, made a statement at her home in New York's Brooklyn borough on Wednesday, Sept. Cathleen Alexis said that she does not know why her son did what he did and she will never be able to ask him. Aaron Alexis opened fire Monday, killing 12 people, before he was killed in a shootout with police. Defense Secretary Chuck Hagel and Chairman of the Joint Chiefs of Staff Gen. Martin Dempsey speak at a news conference at The Pentagon, Wednesday, Sept. Hagel is ordering the Pentagon to review the physical security of all U.S. defense facilities worldwide and the security clearances that allow access to them. Hagel ordered the reviews in response to Monday's shooting rampage at the Washington Navy Yard, where a dozen people were killed. The shooter, Aaron Alexis, also was killed. Police park next to the home of Cathleen Alexis, mother of Navy Yard shooter Aaron Alexis, in Brooklyn, N.Y. Wednesday, Sept. The mother of the man who killed 12 people at the Washington Navy Yard made a statement that said she is "so, so very sorry that this has happened." Bishop Gerald Seabrooks shows a statement made by Cathleen Alexis, mother of Washington Navy Yard gunman Aaron Alexis, in New York's Brooklyn borough on Wednesday, Sept. WASHINGTON (AP) - Investigators have been focusing on the erratic behavior of a former Navy reservist who law enforcement officials say was grappling with paranoia and had reported hearing voices and being followed before he gunned down 12 people at the Washington Navy Yard this week. The Department of Veterans Affairs said Wednesday that 34-year-old Aaron Alexis visited two hospitals in the weeks before the Monday morning rampage but denied that he was depressed or having thoughts of harming himself or others. Alexis, who died in a police shootout after the rampage, complained of insomnia during an Aug. 23 emergency room visit to the VA Medical Center in Providence, R.I. He was given sleep medication and advised to follow up with a doctor. He made a similar visit five days later to the VA hospital in Washington, when he again complained of not being able to sleep because of his work schedule. His medication was refilled. Alexis appeared "alert and oriented" during the visits and denied feeling depressed or anxious or wanting to do harm, the VA said in a statement presented to lawmakers Wednesday. Two weeks before his ER visit, for instance, he complained to police in Rhode Island that people were talking to him through the walls and ceilings of his hotel room and sending microwave vibrations into his body to deprive him of sleep. Navy officials said the Newport police reported the incident to officers at the base security office, but nothing more was done about it because he did not appear to be a threat to himself or anyone else at the time. Despite the apparent concerns over his mental health and past run-ins with the law, Alexis maintained his security clearance as he arrived in Washington in late August for a job as an information technology employee at a defense-related computer company. Alexis had been a full-time Navy reservist from 2007 to early 2011, and a Navy spokesman said his security clearance, at the "secret level," was good for 10 years from when he got it. On Monday morning, he used a valid badge to gain access to the sprawling Navy Yard and Building 197, bringing with him a sawed-off shotgun on which the cryptic messages of "better off this way" and "my ELF weapon" were scrawled, according to a law enforcement document reviewed by The Associated Press. The meaning of those words wasn't immediately clear. The motive of the shooting also remains unclear, though investigators have focused on Alexis's mental health and alarming behavior displayed in the weeks before the massacre. Alexis had enrolled in VA health care in February 2011, and received monthly disability payments of $395 for orthopedic problems and ringing in his ears, according to the VA. He never sought an appointment from a mental health specialist and either canceled or failed to show up for primary care appointments he had scheduled at VA hospitals, the department said. Meanwhile, Alexis's mother said Wednesday she does not know why her son opened fire on office workers and police. Cathleen Alexis read a brief statement inside her New York home, her voice shaking. She did not take questions from a reporter. "Aaron is now in a place where he can no longer do harm to anyone, and for that I am glad," Cathleen Alexis said. To the families of the victims, I am so so very sorry that this has happened. My heart is broken. Alexis had with him during the massacre a handgun he picked up inside the building and a legally obtained Remington 870 Express shotgun. The shotgun was brought into the building disassembled and pieced together by Alexis once inside, according to a law enforcement official and a senior defense official who spoke on the condition of anonymity because they were not authorized to discuss the matter publicly. That firearm would not be covered under a proposed weapons ban supported by the White House. The ban was introduced in the Senate earlier this year and would prohibit 157 specific firearms designed for military and law enforcement use, and it would exempt more than 2,200 others. The rampage and shootout spanned more than 30 minutes. One District of Columbia police officer was shot and wounded in the legs but survived. The U.S. Capitol Police, which protects members of Congress and Congressional buildings, announced Wednesday that it has ordered an investigation into the force's response. The fact review team is expected to look into reports that one of the force's tactical response teams arrived within minutes of the shootings and was told by a Capitol Police supervisor to stand down. The Navy Yard is less than three miles from the Capitol complex. Senate Sergeant at Arms Terrance Gainer said in an email that if the reports are accurate, "It would be an unbearable failure. The Police Board will conduct a review of all facts related to our response. The shooting also raised questions about the adequacy of background checks for government contractors who have access to sensitive information. Defense Secretary Chuck Hagel has also ordered two sweeping reviews of military security and employee screening programs, acknowledging Wednesday that "a lot of red flags" may have been missed in the background of the Washington Navy Yard shooter. "Obviously, there were a lot of red flags," Hagel told reporters at a Pentagon briefing. Why they didn't get picked, why they didn't get incorporated into the clearance process, what he was doing - those are all legitimate questions that we're going to be dealing with. Navy Secretary Ray Mabus, meanwhile, announced Wednesday night that he wants three rapid reviews completed by Oct. 1, including whether a contracting company should inform the Navy if it decides to review a worker's security clearance. That order raises questions about whether the company that employed Alexis, the Florida-based IT consulting firm The Experts, had decided to review his clearance. A security clearance often is critical for contractors working in defense jobs. The Navy Yard, located in southeast Washington, reopened and returned to mostly normal operations Thursday, although Building 197 and the gym, which is being used as a staging area for the FBI, remained closed. President Barack Obama and first lady Michelle Obama are expected to attend a memorial service for the shooting victims Sunday. Associated Press writers Kevin Freking, Lolita C. Baldor, Laurie Kellman, Alicia A. Caldwell and Eileen Sullivan in Washington contributed to this report.