A Milford man is accused of illegally collecting rent from former tenants after he had sold his building on Union Street.