You are facing H-shem as you daven, so you shouldn't think of Him as off to one side or the other. When your mind wanders, essentially your focus is on something else, which means that H-shem is somewhere to the side and not straight ahead. So keep your attention straight ahead.
From Tehillim 16:8: "Shevisi H-shem l'negdi tamid" = "I will keep H-shem in front of me always." At least, do it while davening.
Handy Quick Links
