hanker sore

adj. finding a person so attractive it actually kinda pisses you off.

From hanker, to pine after something + canker sore, which gets worse the more you're aware of it.