When can you use a duvet/quilt on an infant?

When my children were infants....I always put them in 'blanket sleepers' at night time and they did just fine and I didn't have to worry about blankets.