Let me be allusive and metaphorical.
We remember so little from infancy for two basic reasons.
- We are developing the categories we use to form memories. Memories are not video-recordings of happenings but assembled events and actions organized by how those items rank in importance to you.
- Rapid transmission of consistent categorization doesn’t occur until the hippocampus completes myelination about age 4–5. Until then, learning is short-term, of local scope only.