I'm glad I noticed my habit of glancing at things myself.
Better than not knowing.
If someone else actually says that, it's better to worry about it yourself.
I feel like everyone sees people passing by.
Well, there is also a possibility that there is some difference between how you look at it and how others see it.
If you record your own gestures, you might be able to understand something.
Even if you look at it the same way, it might be a good idea to do research on whether you're looking at the other person's face or not, and whether you're looking away in a hurry when your eyes seem to be right.
Also, it may be possible to save impulsive watching by verbalizing “line of sight” or “I want to see” etc. in your head when you want to take a glimpse.
Also, if you have eyes with your partner, it may not be a bad impression if you make eye contact and smile rather than making them run away. (I know a woman like that, but I don't have a bad impression.)
Either way, if it's your own personality, why don't you live your life worrying about your own individuality?