Have a mix! I may be one of those 'fetishists' that prefers coins (yes, mostly because they are shiny and free of defects and have interesting designs). However I don't think it's as irrational as some make out, if you do it with half a brain.
For starters I only go for coins with relatively limited mintages. This means that you should always get your premium back, at the very least. So this means kooks for most Aussies, though with the recent increase of the 300k mintage to 500k (2011 onwards) and now 1M (2013 onwards), they aren't as attractive as they used to be.
Secondly, 10 oz coins make up a fair chunk of the stack. The argument that coins are wasteful due to the premium virtually vanishes once you get to 10 oz and higher. The difference in cost between a 10 oz kook and a 10 oz poured bar is negligible, if not non-existent. And in fact the 10 oz+ minted bars (like the PAMPs) are often MORE expensive than 10 oz coins.
Thirdly, I stick to government mints/legal tender. This at least gives you recognition and a 'trust' factor when trying to resell. IMO minted rounds by private mints, although 'interesting', are the worst of both worlds - the premiums associated with coins, combined with the lack of recognition and less guarantee of purity associated with bars.
Finally, though I prefer coins, I don't go paying ridiculous amounts for them. I'll accept a small premium over a bar, but I'll avoid anything more than a few bucks over spot and as stated previously, mostly stack limited mintage coins (the exception is that I do have some ASEs, but I got them cheap - Maples are cheap too but I don't like milk spots; Phils and Brittanias have too high a premium). I don't dabble in the semi-numismatics/proofs/gilded/coloured rubbish.
Also I should point out that although 100% of my silver is coins ... almost ALL my gold is ~bars~. I kinda see the core of my stack as gold, and thus buy bars to get max gold-per-dollar. Silver is the fun, more risky stuff ... so why not get coins - a few bucks premium isn't going to matter if silver skyrockets, and it has more potential on the upside than gold does in percentage terms I think.