Is this creepy?

We recently closed on a home that had been on the market for about 5 months. When we put in an offer, another buyer also put in an offer (odd, but real). However, because we could close immediately & take possession, the sellers accepted our offer, we closed within 10 days & are moving in.

I was outside moving things from the POD into the house when a car drove past, stopped and the guy rolled down the window and yelled out "so you're the person who bought my house". I was startled because this house is located far outside the city and the house is on a road that's really only traveled by people who live here. This is not the person who sold us the house, they had already moved out of state when they put the house on the market.

I find this to be incredibly creepy and can't imagine doing this. This is the 4th home we've purchased over the years and of course we've lost out on bids of houses, but I could never imagine driving past, seeing the people moving in and then stopping to SAY something to them. Am I being too sensitive?