A quick google search yielded the following results: https://localbitcoins.com/country/NO http://howtobuybitcoins.info/no.html https://justcoin.com/ Always do your research before parting with your cash.
This might help: http://www.cryptocoinupdates.com/buy-sell-and-trade-cryptocurrency/buy-cryptocurrency-with-paypal/
I noticed a bitcoin ATM not far from work the other day. Does anyone know if you can just buy them from one of these or do I need to set up all the wallets and stuff first?
This might help: http://coinatmradar.com/blog/how-to-buy-bitcoins-with-bitcoin-atm/ Bitcoin ATM Map: http://www.coindesk.com/bitcoin-atm-map/
Mycelium is good if you want a phone based app wallet. I'd double check you aren't getting ripped on the spreads as normally BTC atms are expensive, would use Bitfinex as a reference for the market rate https://cryptowat.ch/