Is it wrong to have sex while the baby is in the room? No. Definitely not!
The fact is babies (especially newborns) can sleep through anything, including the sounds of sex. But if the idea bothers you, experiment with having sex in other places in your home (kitchen, bathroom, closet, etc.).