Maybe I'm too tired to find it. What it say? I didn't see any
restrictions.

wrote:

http://www.irs.gov/publications/p936/ar02.html#d0e1821

See Part II: Limits on Home Mortgage Interest Deductions