There is nothing in this world that should be able to come between your relationship with God to allow you to separate yourself from Him; whether it be a person, place, or thing, even the cares of this world. There is no problem or situation so bad that you need to disconnect yourself from God. The greater your problem, that is the time to stay closely connected to God.
Also, if there is something in your life that causes you to turn your back on God at any time, then you really need to look at the thing that is causing you to move away from God; it may just be that you may need to move away from that particular person, place, or thing.
Romans 8:35 & 39 says “Can anything separate us from the love Christ has for us? Can troubles or problems or sufferings or hunger or nakedness or danger or violent death? Nothing above us, nothing below us, nor anything else in the whole world will ever be able to separate us from the love of God that is in Christ Jesus our Lord.”
Be blessed, be encouraged, and have a great day.