OSSIPEE, N.H. (WHDH) -- A case of alleged elder abuse has pitted brother against brother. One brother says the other abused and stole from their own mother after a private investigator found the woman with a broken hip at a home in New Hampshire.

Daryl Brown was in court just days after his mother was discovered in Ossipee, New Hampshire.

"We're actually still trying to get to the bottom of that. She was exploited financially and, I believe, emotionally and I think we haven’t found the whole story yet," said Daryl Brown said.

He also hasn’t found the money he says his twin brother Darin Brown and girlfriend Sharon Giordano allegedly stole from Joan Brown.

"What they did was they drained about 80 percent of her account in 12 months; $650,000 has been taken out in 12 months 32 different times," Daryl Brown said.

The 80-year-old living in Stoneham off interest from an inheritance, was secretly whisked away to New Hampshire in March where investigators say Darin Brown and his girlfriend went into hiding when Daryl went to court.

"It’s just an extreme and outrageous manipulation and also mind control of undue influence over this vulnerable woman," said Alex Moshchella, attorney.

Mrs. Brown was found in the couple’s home on Monday, with a broken hip and bleeding internally.

"Within a couple of days she would have passed away," Daryl Brown said.

While she remains hospitalized, Daryl Brown continues fighting for her, berating her well-known financial planner and his own brother whom his lawyer refers to as the “evil twin.”

"They're despicable people. They took advantage of a woman that was very kind hearted. I have absolutely no respect for either one of them," Daryl Brown said.