I guess I'll wade into these murky waters and put my Philosophy degree to good use, lol.
Whether one believes in a Creator or not, there is a belief about the existence of some absolute of reality.
The Absolute for the theist will be God, obviously. The Absolute for the atheist will be the natural universe, subsisting by itself. The Absolute is the first, primordial, unchanging "thing" from which all things find the source of their being and in which all changeable things exist.
Now, the question is whether the Absolute is a conscious, personal Being (aka "God" or something like It) or is an impersonal "force" of self-subsisting nature.
The "Big Bang" occurred, starting the existence of space-time as we know it. Now, it does not matter whether there was natural existence prior to the BB, as there would have to be an original, absolute starting point for all subsequent causes sometime in the distant past. There cannot logically be a set of infinite antecedent causes, or "turtles all the way down."
The atheist postulates that impersonal nature exists as its own cause (self-caused existence), and that no conscious, personal "choice" of any entity was necessary for the BB and the existence of the Universe. The theist postulates that the universe exists as the work of an active Creator.
This is why I find the argument of the theist stronger: Both the theist and atheist must rely on the existence of some Absolute to explain reality, but the Absolute of the atheist is incapable of self-movement, and thus incapable of causing anything to occur. The Absolute of the theist IS able to cause the universe to come into existence, even if that is all It has ever done (Deism).
The argument of the atheist against this point is usually that causality doesn't matter and that our universe may not be bound by logic (at least, that is the response I have most often received). I find this response both alaraming and unscientific; in fact, it renders science useless if the universe is not logically consistent. The scientific method and the presuppositions we use to do science are invalid if logic is only a mere human construct.
Some atheists, in their desire to use science to destroy the idea of a God, wind up destroying the basis for science, too.
On the problem of "what created the Creator?" Again, this presupposes some prior existing Creative force before the Absolute. But, as the Absolute is THE Absolute, it exists because it must exist, it is uncaused, and not caused by anything. This also applies for the atheistic idea of eternally self-subsisting Nature.
Now, the atheist could argue back that Nature, itself, is this Absolute, but something within it spontaneously occured to start the universe (the funky stuff that quantum mechanics does). Again, however, there would have had to have been some prior-existing reality which would have allowed that quantum funkiness to even occur.
I don't believe the issue is whether or not some "God" created the universe, but rather if that God interacts with human life. The practical life of an atheist, agnostic, deist, pantheist, etc. are minimally different because they all believe in the lack of a personal God that has dealings with people. The lives of theists are (supposed to be) practically different because they believe in personal deities. I find the belief in a personal, benevolent Deity to be a difficult one to hold, given the rampant pain and suffering in the world.
In summary, I think that logic shows that a "God" (or, better called, an Absolute) exists, but that doesn't mean it is the personal and loving God of revealed religions.