Ultra-wealthy Americans are flocking to this obscure town