blockchain.info have a good wallet for holding bitcoin that doesn't require identification or anything, and the keys are stored/created in the browser so that they don't know them. Its easier to sign up with an exchange if you want to trade back and forth though, just choose one of the big ones...