A priest at my church congratulated a family for baptizing their heathen baby. Should we have been upset?

There was an audible gasp from the congregation. I had never heard a baby called a heathen. I don't think I like the idea of calling an unbaptized baby a heathen even if it does fit the definition.