Here is my 2cents.
I also bought my first house back in 2003. I looked at different houses and we saw different problems. There were 2 houses that we really fell in love with but both had issues.
House A - Hardwood flooring on first floor. Finished basement but air ducts are all rusting. Water dripping from airduct. Bottom ptw was rotting.
House B - Finished basement. Carpets on first floor with some stains.
We chose house B since we had plans on changing it with hardwood. On house A, even if it was beautiful, we were worried about our health. Sure it can be fixed but it would cost us around 5-7k to fix that problem. Oh, and one more, both me and my wife said that this is "IT" on house B. It's the IT thing!
If you really like the house, go for it. If you feel something unusual about it, talk to your partner again about it. Make sure that have that great excitement to the point you want to move the next day, you want to drive by to see the house again. That's how we were back then. You know what I'm talking about.