The trustee charged with recovering money for Bernard Madoff's victims says he plans to sue his brother, sons and niece.