If you take money out of an IRA prior to age 59 1/2 you'll be paying taxes on the money and on April 15th- you may be subject to an early withdrawal penalty.  There are some exceptions to this penalty including qualified purchase of a "first time" home.   The Roth IRA will be treated differently, as contributions can come out at any time.

First-time homebuyers (which the IRS defines as anyone who hasn't owned a house within the past two years) can avoid the 10% early-withdrawal penalty only if they use the IRA money to pay qualified acquisition costs for a principal residence before the end of the 120th day after withdrawing the money.

Kiplingers provides information on IRA distributions.