There was a verbal agreement and he is not a man of his word.
If he's breaking a verbal contract confront him with it, if you can't come to an agreement, leave and don't pay him. Have you done any research on renters' rights in your state? Most times the law stacks the deck heavily against the landlord.
Men don't get in fist fights to settle disputes, they don't destroy the property of others, they have the courage to speak their mind, empathize and come to an agreement.