Infatuation at my job...is it right?

I got this job, and it gets on my nerves. However, there is one thing I look forward to--seeing this one man. I am married, and I know it's wrong. When I see him I get a little excited, and when I don't, I feel a little down. Nobody knows this secret. I'm pretty attractive and I notice I get checked out a lot. I've caught him looking a time or two, but of course he has done nothing inappropriate and I haven't either. I'm just attracted/infatuated. My husband and I are not very intimate lately, and we went through a rough time a while back. I care a great deal for him, but I feel guilty with these thoughts. Also, I want to stay at the job and my husband wants me to as well. What can I do to remedy this situation? I'm not a bad woman, not yet anyway.