Unfortunately, the brother is the one in control because he owns the land it sits on… else you can basically move the house to another location, it looks bad. I would advise you for long term satisfaction, to file a lien against the property and someday when they want to sell it they’ll have to deal with you. For now… your best option is to have him agree to buy you out.
Best of Luck!

