You can buy the land and hold it as an investment in a self-directed IRA. The problem is the personal use idea, which is a no-go under the rules for these types of retirement plans, said Meg Zwick, director of alternative custody services at Millennium Trust Co., an IRA custodian that offers self-directed plans.