If they break eye contact before you make the gesture, wait until they look back at you to try again.
In Brazil, for instance, the gesture of bringing your fingers to your mouth as if you kiss them signifies the enjoyment of a meal and not a sign of affection.
For instance, if a person has already rejected your romantic advances, avoid blowing them a kiss.
