everything is fine except for one small defect (idiom); the fly in the ointment

This table is fine except in one respect - it will not fit into my room.

That place's food is great, and their prices are good, but the fly in the ointment is their terrible location.

The only thing that would have made it better is if it was cooked.