I agree you do not have to agree to changes, but that would likely mean returning the car and paying a prorated amount for the time you had it. The dealer would have to pay you for your vehicle that you traded in.
Read your contract. This is not an unusual situation, but the dealer only has a...