We use experimental methodology to demonstrate from two separate domains (learning segmental phonology in Turkish and learning inflectional morphology in Romance) that not every pattern in a language, even if statistically robust or exceptionless, is actually learned by speakers: unnatural patterns are underlearned, suggesting that humans may bring formal and substantive biases to the task of forming grammatical generalisations.