The tax office isnt stupid. If a land sale event occurs then there will be a corresponding payment. The best you'll do is buy at the unimproved land value as assessed. Pay stamp duty on that. Hand over enough gold at current market value to fulfill the contract. Pay capital gains tax on that amount of gold. Now that might not be enough for the vendor. So he might also then get a gift of metals or whatever as goodwill or somesuch. I'm not a tax adviser.
Trouble with any extraordinary inflation or hyperinflation scenario, presumably almost ALL of the value of the gold will be CGT liable - say gold goes from $1,400oz to $10,000oz, you've got 30oz and suddenly that 5BR home is available for $300,000 because the arse fell out of the real estate market - you've got CGT liabilities on a "capital gain" of $258,000. If you've held it for more than a year you've got your CGT discount, but you're still up for CGT on $129,000 - even with no income that would propel you into the 37c bracket - could be a ~$37,000 tax bill just for doing the swap. Stack enough to pay CGT too