This fairly common fungus is widely distributed in Australia and across many islands in the Pacific Ocean, including New Zealand. From its natural habitat it appears to have travelled to other parts of the world in garden or soil products.
Starfish Stink Horn Mushroom

Mike Young [CC BY 3.0 US] via Wikipedia