Yes, and congrats!! A child born in the tax year is considered to have lived with you all year, even if it was born on December 31st , but you must first secure a Social Security number for him. File a Form SS-5 with your local Social Security office if you have not already done so.
http://www.irs.gov/faqs/index.html

