This paper highlights the risk that non-linear machine learning models can learn rules that violate ethical principles and social norms. For example, years of experience can be a proxy for age and penalizing job candidates for having more experience can constitute a form of age discrimination. The paper illustrates how monotonicity shape constraints to can be used to remediate model violations that can cause social harm.