Here are some links to information about applying for passports for babies:

USA - Special requirements for minors - US Dept of State, Bureau of Consular Affairs

Canada - Passports for Children - Passports Canada

Australia - Children’s Passports - Dept of Foreign Affairs and Trade, Passports

United Kingdom - Applying for a child passport - Home Office, UK Identity and Passport Service

Ireland - Passports for Children - Dept of Foreign Affairs

South Africa - Passports - South African Dept of Home Affairs

New Zealand - Passports for Children - Dept of Internal Affairs