Yes you can. Use your rational sense and reign it in. You have a responsibility to OTHERS to do that, especially men toward women. But also vice versa.
What role is this person playing in your life? If it’s professional engage your rational mind pronto.