My boyfriend keeps putting it in the wrong hole...?

when we're playing crazy golf? He always does it in a really random order and it's so frustrating because we can't play the game properly!! I've told him to stop putting the gold ball in the wrong holes but what should I do?