He does in theory, but we don't know what infinite means in a realm we have never experienced. Infinite is a human construct. While I wish I had all the neat, tidy answers, I will leave room on this one for what I don't understand about God's realm.

What I do empirically know is that God is more infinite than us, especially from an uneducated Old Testament shepherd's perspective as he wrote down the things he saw and experienced.