Make eye contact with the people passing, nod to them, gesture keen interest in talking to them at a later time, point to your phone, shrug and move on.
The user has to arrange the phone so a virtual “error box” is situated around his or her eye; the system can recognize the eye as long as it stays in this box.