Yes, that does happen at times. Depending if the person has been nice or not, I may take the blinds quickly or actually try to wait and see if the other person comes back. Some think it is stupid (and it may be), but I like to give people a chance. It the person just does not come back shortly - a couple of mins, then I take the blinds quickly.