If he's showing up in your Immediate Family, look to the right of that heading and you'll see a link labeled "View All". Right below that is a link labeled "Edit" -- click Edit and then you should be able to click the Remove button to remove him from your Immediate Family module.