Einstein was not religious in the least. He did not attend temple and he did not pray. His references to a Supreme Being are vague and almost of the nature of childish parables, as when an indulgent parent speaks to a young child.
No one, none of his best biographers, understands just what Einstein believed or did not believe.
Einstein does not seem to have been an atheist, at least in the sense we usually understand that term, but it is equally clear that religious matters were utterly unimportant to him.
Einstein never explained himself definitively in this matter. It wasn't important enough to him to think hard about.
We have a clue in his views of quantum theory.
Einstein, despite being, through his work on light and black-body radiation, one of the founders of quantum theory, could never give up the idea of causality required of quantum mechanics as it developed more fully.
He just instinctively accepted causality in physics, often remarking that it was just our limited knowledge that kept causality hidden in modern theories.
One has to assume he just had a vague inkling of extending causality through to the beginning, but these were not issues that worked on his mind.
As to admiring Freud, Einstein was actually rather dismissive of the theories of psycho-analysis.
There is a certain ambiguity about Einstein on all matters not having to do with physics. His pacifism. His Zionism. His concepts of nationality. His work on all these was confusing to others. He tried working with organizations on these, but he hated such work and was ineffective. Others, such as the ardent Zionists, used his name for credibility and contributions.
He embraced pacifism and found nationalism annoying, and one has the feeling that these views had to do with his need for quiet and privacy to just think.
I think of him as a de facto atheist. The only matter that truly mattered to Einstein was his physics.
