When feeding to sleep, you can safely unlatch the baby once they enter deep sleep, which is typically marked by a significant slowing of their sucking rhythm, even if they continue to move their mouth slightly.