NO fraud , he just took you legal , and thats it!

You signed the papers and you gave him the money. He didn't take anything, therefore you were just taken for a fool. Nothing legal can be done.
You learned a lesson, right?

I am really sorry this happened to you.

I'm NOT a legal expert, just someone who saw your question and wanted to try and help.

I think to claim fraud you'd have to prove that he was out to steal your social security money. As another poster pointed out, that money is intended for you and you alone. If you freely handed him the money without coercion, it weakens your case and I don't know if you'd get in trouble. At the same time your judgment is impaired by your disability.

I would contact an attorney and lay it all out on the table. If you have a case worker they might be able to find you free representation. Be sure to save all correspondences you've had with the guy to be used as evidence.

Good luck!