You can deduct the rest of the activities across the lifestyle of mortgage